Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00061_00000_shuffled.ds.index79 linesDownload Raw Back to root
13	Is��$�$�%.H.l1U3�3�3�3�4%6�67�<�<�>!?
B�CSF�F�G�GHL�LJPpP�P�QRSXU[�\X^`�a:bVd�dUf*o�o�pr�t�>	�	't
jjq�k�7���_�������
���ݛ����������ٮ�&�ô�{��������C�<���o�l�������������]�e��)���9�������'������������x�~/�K�/2�(6
X��{�����8 s � �4�8R�S�U�V)Y_Y+Z�Z3[wd�f�i-lzL{�y�#�v���=�������u���������N�[�������w���H���"�k�����������������$�r����D�4�x�������(�s�	4 5��
�
��d�Mw���}�! "�(�)�.=/c0�1]2�2~4�5x6�:�:�;�;fB�B,F(KN4U%VW�W$X�X�Z�]�hzi�i�k+l�p^r$st�v����<�-�E���P�q����K�ԕ���=���&�S���Q�����p�G������)6.7!M��R G!'�*�+�,�-J.�12?2�3;4o56A�AYB�\8b^9�z10�z11�~12�13R�14�15�16(�17T�18K�19��20!�21��22��23+�24Ĺ25�26��27��28?�29��30��31��32P�33��34��35��36%�37��38��39�40�41��42T�43��44?�45O�46��47n�48��49��50�51C�52$�53|�54}�55��56W�57B�v
��m���y5�5�7,892:Y<Q=q?�?�F�H�Y^^_�_�l�m9n�o�s�s�u�����P�e�9���8������%�>�v���Ѣ/���������ޭ>�|���2�'�t���������S�������h���	��������Z�1���������g���\���,�>�<���	'	:	�	:58�59�|
60�����,o-�-�-S.�.�4�7�BC�G�H_IK:LdL�T+W�YZ�[Rad}u�{B|�~�l������y�:�����χ[���s�݌����
�l�ő�<��J�����1�àء����`���W�w�׹�� ���_�V�>�����U�/�*���t�����[���U�����{��=
�

�

.
X
�

V
h
�
�
�
�
�
�
�
� 
%!
&)
�*
�,
�/
G1
3
�3
X4
}5
6
Y?
zA
aF
�I
�J
�J
lL
{c
qe
Kg
h
r�
φ
�
��
�
I�
\�
q�
w�
7�
��
�
��
ə
L�
Λ
ם
��
��
��
��
B�
��
֩
��
�
��
��
"�
�
��
��
��
Y�
C�
��
��
��
�
T�
6�
+�
��
��
��
M�
d�
��
$�
E�
��
i�
��
b�
��
'�
M�
��
>�
M�
r����5!b!N#�$�$�&�)�*�*�+�04�6�6�8�9
:B:;e;�;>>�@�A�KRL<T�T�\	_B` a�gh�hdn�n�x�y z�{�|}�~��F���6��u����������@�V�t�h���]���q�ΰ��2���ϳ�,�_���)�C������@2�2�3!5�KCN4O�O QBV�V�Y�f�g�hbi�i�kAm8z�z+|����-�����ޕ��W��������*�k������	���
R��� ��?� ?#~#�&�&�'�(!)�*�+�,7-D.�9�@�A3H	I�I'JOhTGVWX�XK[^8^�|�}�!������9����f�@����š�N���֬�������P� �<�ݼ�&��l�s�]���$�_���6�����I�U�S���������� �w������0�w����C����������@���@�P�d������"9"�./&0[AB8CrC5F�F�QIS�S�TU�W�`�a?b0h�h�i	j;kl�mXn�o�}�~`����R���;�������	������U����������k���X�$�5���K�����61X��+�J)z*�+�+G,B-;5�6.8�C,J�M�McN�NyO�Q�T-XCX�XLYqZ�jpl�l�lXm3nan:p�q:s�s't�u�x_y�z]łX��������ȹ����u�i���X�%�7AE,���R@�*++�/�0I1b6�6�9<?�@6B�B7DwD(EN_N�S�S
VQW�WX�YU]~^;_!`,b�b,c{c+dirijl|l$n�ovp+qIq�r+s�{�|C~M������̃��ה�h�������>�ݞ��&�9����˭r�ܮS������E	62��
D�BFy	_���9 �#�$%8&�'F*+�-�.�/�0�0�1�1�1s2�3wB�C�C�DmHWJ%LOMANwP@Q�QkR5S�T�UUX@`�ce�f.i2�����9���|���C�w�S�q�����o�̫̲��`���/���Z�g���V�J�M����������������������o���6���^���������e��� �{���h|8�U���)�)�/3&7)8�<o=?�@�B�C0F�FINlO�P�Ps_\c�cYdAf�psq tv6vnvw�ysz{M���/�`��������i��v�������W���<����ͥW����,�k�Ҭ�������y�w������@����c�E�;��b��A63�64;�;�<DB�~�
�R� ��4�@�Z�a�äx���1���!������+�����`�����[���u�[�"��|�65�z����Q��J���N�t����!��G8�<]	�	����7�#$6$�%�)F*j*�*V3>4�4,5h7�7�8�>�?	B DYF�G�H+J�JNQN0R2ef�g�g}o�x�Ą
�j�L���#���*�է'���q�0���d�Q�.���O�'�Z�������a���h�$����'�������"�{�{�4��j�����J���IG	66�67�]
|
�
{� �$%&�&�(�(�0682S2�2�7�8J9H=b�c7f�hUi�j�m�npap�q�t�v?{�{69�:����,�[�9�Ű��F�+������ο�+������-�J�q����������[�Q�����p���)-3�3�7e9>:�<=�=�=�D�I�JU
XuXY�cWd�d�m^nht�t�v�v�wy�y�z�{D|K}�~#������3�����O�-������������$���o������������"���A�O�� .   � , Z	 � [
 �
 Z   � � � h ) �    A � � g �  �* �- 0. �0 	1 �3 �E �H =I �I 3L �W �f ?g &k &p �p �q ��!U�!/�!��!B�!��!<�!{�!��!��!��!�+","�/"�\"�]"`a"�b"�b"�g"�h"�i"�j"k"�k"q"Bs"70u""|"�|"?�"^�"�"�"^�"��"R�"�"j�" �"u�"��"��"?�"��"5�"b�"j�"��"�"�"X�"l�"I�",�"v�"�"��"t�"��"/�"�"��"��"w�"��"�"�"�"�"��"��"�"��"��"�"�"-�"��"	�"��"R�"��"��"Z�"z#�#E#�#|#�#�	#�#�#m##�##T#S#�#�#�$#�&#�'#q-#�/#00#<1#Z3#�3#�6#_#�c#d#�d# e#�h#�m#�n#�o# p#	q#�q#�|#�|#��#��#�#$�#�#_�#��#�#��#ڽ#��#5�#��#��#{�#��#l�#��#i�#i�#��#��#��#��#��#r�#��#}�#��#�#��#��#��#_�#��#\�#B�#��#8�#��#P�#v�#0�#�#t�#�$q$�$�
$($;$�$�$>$�$0$>$]$�$#${$�4$B5$8$�I$�J$�K$�L$M$QN$�N$�N$�O$�P$`Q$�Q$�S$9U$�V$DX$�c$^d$)e$bf$�f$�f$�j$nk$�k$m$gm$er$<u$�u$�y$m{$`|$5~$ۂ$��$�$��$$�$Q�$��$��$T�$E�$�$�$Q�$n�$�$��$8�$��$��$<�$j�$ը$��$Y�$��$��$��$�$9�$��$�$��$�$��$Ͽ$�$��$|�$��$J�$��$��$��$��$��$��$��$�$��$�$I�$��$��$�%$%l2%�3%v7%F8%�8%�9%�9%�B%F%�G%6J%oL%�P%<U%�U%�W%+X%�Y%Ra%1b%{f%�f%�k%�k%Am%�m%Ln%�n%Bq%�t%-v%�v%71w%7x%b{%�{%(|%C}%�}%�~%(%E�%q�%*�%��%ق%��%��%s�%'�%�%��%��%1�%/�%��%�%�%_�%c�%��%_�%��%��%�%��%%�%[�%��%��%=�%��%,�%��%��%��%��%{�%��%^�%O�%��%/�%�%G�%��%��%��%��%�%/�%�%��%��%��%E�%��%9�%/Z&�Z&�_&�`&a&#d&�d&h&7n&p&ms&�v&�w&�x&��&Q�&�&7�&C�&��&�&:�&n�&Φ&�&��&��&��&��&��&��&u�&��&��&�&V�&q�&D�&��&��&��&��&��&��&��&?�&��&%�&b�&��&�&8�&��&B�&h�&/�&��&''�''h'|'j'�
'�
'j'�'�'�'�'�'�''�']'�'�'�)'*'�G'�]'�]'U^'�_'(`'ia'�a'Ic'8d'xf'g'�g'�j'�l'yo'�p'��'$�'*�'o�'�'��'y�'Q�'��'T�'�'m�'��'��'!�'q�'Z�'��'I�'s�'��'�'��':(�(�(�(�(�(�(�"(�#(�%(['(�'(((�((t/(�4(�7(`8(H;(�<(�K(�L(�N(1O(:P(W(0W(oW(�a(Cb(c(�c(k(qk(�k(Ml(�n(�n(hr(�~(\(�( �(݁(+�(��(�(��(С(7�(�(5�(;�(�(��(��(��(ۭ(@�*u�*��*�*�*��*>++�+"++J+�+r+�+�+/+�"+�&+'+d'+�(+�(+�*+�B+�F+KJ+�J+�L+8O+R+;S+KS+�S+�T+^X+�[+^+�b+De+�g+,h+�k+�l+�n+o+&o+wo+�o+p+�p+��+%�+��+�+��+��+�,,u,,,C72,�73,�
,,Q,,7,�,�,4,�,�,�,� ,"!,�",|#,�#,,,�4,�5,�7,�7,?8,�>,B,FB,�B,C,4D,�H,�I,pK,�K,�L,�M,eN,�N,�P,�Q,�R,mS,�T,	U,,U,mV,OX,&Y,wY,�Z,_,y_,�`,b,�b,�d,Fe,�f,`g,�h,l,�l,�q,ss,u,}v,fx,�x,�~,74,J,�,Q�,��,K�,n�,Ҋ,��,��,��,��,��,��,��,,�,��,i�,�,�,��,��,%�,�,0�,��,��,�,+�,7�,��,�,��,u�,0�,v�,q�,&�,T�,��,��,~�,(�,9�,��,�,u�,�,��,��,1�,��,��,N�,X�,��,�,��,�,z�,��,�-8--�-�-�-$-�-c-�-e#-z#-l+-�,-^:-;-�;-n2�n2�o2�p2�y2|2�|2�|2}2�~2\2<�2(�2L�2�2�2ӟ2��2��2�2c�2��2��2�2��2��2��2�2��2��2�2'�2��2��2r�2��2��2=�2�2z�2�2]�2��2��2��2N�2K�2��2��2��2��2D�20�2��2z3�3�3�3�3\)37*3�*3�*3$,3	.303x037533�33�33|43�=3�?31A3�F38M3ZM3,N3dN3wO3P3�P3V3�X3]3�b3Id3�f3�h3m3�o3�o3v3Vv30w3Vw3�w3=x3sz3�z3s{3�{3�~3��3ӌ3Z�3�3Ƒ3�3��3�3o�3��3ѥ31�3�3��3E�3�3[�33�3u�3j�3W�3V�3!�3��3��3�3h�3��3��3�3��39�3{�3Q�3V�3��3��3>�3��3��3+�3��3��3G44�4�4z44�4�4�	4n4d4�4�4b-4a04y04�04?84u841:4�;4 <4I<43>4~@4A4$C4GN4�P4�Q4�f4�f4�i4�i4$n4o4�o4�p4�u4�y4U|4s�4D�4�4H�4׎4��4��4�4U�476�4��4��4��4s�4�4V�4��4��4��4x�4��4-�4��4D�4��4{�4��4��4}�4��4��4��4�5M5�55�5�5�5�5� 515�15�15�25�45<5�=50>5?5�?5EB5�B5OD5�D5IE5�E5vF5�H5�L5IM5O5�O5�P5R5UT5w]5�a5hn5�p5�r5Ms5��5�5�5@�5j�5��5k�51�5��5Α5��5�5ؙ5��5��5ן5�5��5��5&�5V�5�5R�5��5U�5!�5��51�5��5��5��5��5�5�5�86�F6�H6AS6�S6m\6�^6n_6�_6�`6�h6�k6�n6Du6�v6�w6�w6�67�6��6(�6V�6�6c�6A�6o�6�6��6|�6��6��6_�6��6��6��6'�6��64�6�6*�6��60�6"�6��6��6��6��6o�6��6C9�C9�D9�E9�F9�F9�J9aM9pN9BO9qO9�O9�O9�P9�P9|S9�S9CW9�W9�Z9�]9^9 a9Ya9�a9qe9�f9�i9�i9�k9u�9�9��9��9��9��9ə9��9��9��9��9�9^�9H�9��9�9��9g�9�9��9�9#�9+�9��9�9L�9ý9{�9��9P�9��9$�9��9��9��9�9l�9��9��9D::�:�	:;:�:U:�:�::!:�:::�::�:�:&:�':�+:�-:g/:�/:3:�9:�9:�::<:�=:;>:o>:<?:�A:7C:RD:TE:�P:RR:)e:�e:mi:j:�k:�m:
n:��:�:��:�:b�:X�:��:Q�:W�:џ::�:��:��:x�:X�:��:L�:t�:��:M�:b�:�:��:&�:�:N�:��:i�:.�:7�:�:��:��:�:��:�:6�:�:M�:��:k�:��:�:��:,�:��:��:9;� ;� ;�!;o];�_;�`;qa;pb;Xe;ch;�i;�j;�y;l};��;�;��;�;�;��;@�;��;��;^�;?�;�;��;r�;"�;��;��;t�;m�;�;<�;5�;�;��;+�;��;K�;��;��;�;��;<"<�<<i<�<�,<�-<I.<�1<\7<�G<3H<CI<9�<��<��<J�<��<�<�<�<u�<��<�<�<�<�<��<�<ĺ<��<	�<��<��<��<��<��<X�<�<��<��<E�<��<�<4�<#�<t�<��<�<��<n�<77�<]�<��<�<��<��<�<g�<=�<��<��<��<��<�
=A=�=�=D=�=�=H=�&=3'=�)=6+=u+=�.=:/=1=42=�4=.5=L5=	E=HF=�F=\I='[=�\=�a=cc=�c=�d=ce=f=!j=/n=�n=o=�q=er=Ow=�|=�}=�~=c�=��=U�=E�=��=��=w�=�=��=��= �=n�=|�=��=��=�=78�=��=W�=R�=�>:>�>�>79>x>�!>�$>-%>R)>�)>�)>�*>z->5>�5>�:>e>�e>�g>3j>�j>;k>