Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00025_00000_shuffled.ds.index75 linesDownload Raw Back to root
1\P��
�W".��x$$5&1�1w2�4�4GNFO�P�T^g�g�g�yz��%������@�7�"����r��D���E�����V�0����̼y�U���}���z�r�C�|���^�����n������P����p�"�����-�G���
���Z���G���]�8
�
�L8!9�9�:�;2<�<==@�@�BZCuG3H�HI;IpIITlWuX8Yx^$`�`�d�f�fCodp�prs�s{�}_~,U�>�+�,�̅7�h���Ҏ�ŖS����N�6���#�b�Ť��6�pW����#O&�'2(�(***�,�/1�1�4�426�6!7�7�9:�=�AhF�FHG;H�I4JdJ0KhKRLM�M�O�P'Q�SjY�[=\�]�^ia�d�i^t�tOxzlz�{}7}d�)����Ƅ�������D�a���ڒ�����������˜ٜt�ɤ/�C���*���$�����E�������Ce�~i�B !�!9$�+�+-=8?�BG7G�G�HK[K�L�NVX`Y�Y Zo�p�z#{�|�m�a��������dž'���t���'��������S����h�����������L���w���=���^�v���l�'
S �!#%)&�&*�/�0;v<�=�=�A�COPpS�W�XY�[d\]|c�d�k�l�wLx�{};}�}�~�~���F��݋������u�ڕ_�������a�՟Ӡo��ɩ!���������w� �*��D�����(�}�'������Y�����?��������X��F�w	�	
		*	�	�	"	\)	I*	�0	�1	2	�4	�8	�8	HK	�K	�N	�O	�^	Zb	�b	�c	Of	��	��	_�	N�	��	��	Щ	<�	U�	 �	�	�	f�	��	��		�	B�	��	b�	a�	�	��	v�	��	R�	��	��	D�	��	��	��	@�	��	�	��	w�	��	��	��	R�	��	��	��	=�	5;6�7�8)9�1011�12w13�14�15�"16-417�418j519�620W721�722e823�924;25�X26#Z27\28I�29c�30��31��32E�33��34��35�36v�37��38��39-�40p�41��42�43#�44l�45b�461�47��48	�49'�
��
ڧ
��
�
U�
��
�
D�
��
B�
ج
��
�
 �
�
:�
��
:�
ٽ
��
��
��
��
P�
	�
���C*	Cv(V� <<?�FGG�H�H�I�K\QR`XuXRY�Z�Z�Z]�c�d^g50n�o�v	wƒ��X���ϓ�+������¡բ1�����:��x��r�����P��R���o�������q�j�����7����>�����C���t�m�F�O�5��51q�����)!�"�.�.�/C11@YA.EjH�HV\�_�a�a�b1g�j6k�k�n�n�s�sYu�v�|�}�~������ڋ��l�Ҽ������i����������������
�
}k�[����#d%���`��/��Űw�W���R�Ѹ���P��������(�6���v��������������^��w1�N�9��H}��a�'.j/�:�;�<�DpE�EI	L�QT2TU�\/]�_�fg�gIj�j8lm�o�o�p�r.t�ulw0x;yTy���>�C�������ߎ�������d���&������-0N0�8)952:&:<:H:�:�;<�<�=�=�BkC�H`JN�N)PcPqQX�[�[$\�^�`)drd�deg�g,j�jEq.r s{s�yz^�Ɂ��J������53�9�Ԉk�����%�f������x�j�$������"���,���n���������w���������������Z��H1I,J�J�JqMeN�SWT>XWY�Y�\54]^9^�`����C���:��������"���9���)���O��{�A|� *"j"K+.,a-�3wKLR�b�c�i�lo�p�p�q�r"uv�����,�ܯ�k���������*�������a���������j�!�x������#$P%�%M,�/�45�9:�LN&O%m�r�st�uTv�w�xh�����ۋ��ʍВ��H�a�*����Y�_���l�/�ɨ.�`����!��R�#������3�4c89K9yW;]Z`�`c�c'd\f�gB���d�1�������@���c�x���P����?������s�_���������-���"�a�u�������#�����W���M	k55"
���"&$�%O)�ekf�hIis�s/t�t56u�vXw{};~�~_���C���K�57����&�����-�F�]��>�i���w��@���v��� �E����������M�����M����cM�Eu"�"x.{/�2�3�9;y=z@�@�GI;J�LCM�R<TU6U�UpViW�Z�]^�_xbc�cg�j�ljmon0o������������)���b�.�C�ۡ��k)��4	�	Y58?��
n\E)s�C�H|����[|�$�%'�)�)�+�+7122|2�35�6;n>�C�DF�P�PU�U7W_W�Y�Z%[	]b2cOh�j5km�mJn�~^�C������)�Ė;��������5�(�	�̮Q�'�д��ڶ��������������#���<���	�h�R���
�6����������"��	�590������!�"�(�*�,*.�./�P�RAS60T�T(X�XY�[�[�]_�g2h�hSi�j�o7qd�������.�������� + � � K | 	 z M x q  # �# �' �( �* �+ A, z, �, �. 1 d3 �5 JB |B nC �C �F �F VJ �J �K �K O 8O YO �T wX �Y rZ [ �[ �\ �^ �_ �b �c �f k zk $l &o �x >y �y H} \} �} 6� 2� $� b� Ɍ �� Z� “ /� �� [� o� �� �� b� �� �� <� �� t� w� �� 0� y� � �� L� �� �� �� 5� �!�!p!�!�61!�62!S!M!�!�!%!�!�!�!�#!2(!)!*:!�?!sP!�P!:Q!oR!sW!�W!7\!�e!�i!�k!�l!�n!lo!�s!t!�t!sv!�|!#~!�~!�!׃!=�!��!�!��!�!܋!Y�!Ε!ۗ!W�!��!��!�!��!��!��!��!&�!-�![�!�!b�!��!l�!��!��!�!��!�!�!��!��!�!!�!q�!��!N�!?�!��!��!��!��!��!��!R�!Z"*"";"E"�"!"�"#
"�
"K"G" "'""^"�"�"-"�""�#"!$"&"�&"8'"j+"�,"�/""1"o1"�1"�7"�8"�8"�9"�A"{C""F"8F"�G"BJ"�L"�O"�S"\X"�X"�X"mY"1["�["�["�\"4`"�`"Lc"8e"�f"6l"xm"ao"�p"�p"q"r"�r"1�"�"�"�"�"L�"'�"^�"�"��"/�"��"��"Z�"��"߶"��"7�",�"��"�"D�"7�"��""�"�"@�"�"P�"��"@�"l�"�"��"��"<�"?�"��"��"�
#\#$#�#�#�*#v.#5J#R#�T#2U#�Y#�Y#�Z#�\#^#F^#�^#;`#b#d#,e#	f#�g#�i#�j#Sk#�l#�n#np#�p#Oy#�{#d}#�~#F�#��#�#��#Ֆ#��#l�#p�#~�#?�#��#;�#~�#�#��#��#˶#s�#[�#S�#��#��#E�#��#��#��#B�#��#��#t�#��#4�#��#$�#��#��#��#�#T�#��#��#��#��#��#��#)�#��#��#��#"�#�$�$�$�$$\$�$�$�$$�$Q!$�#$�1$�3$�4$�6$�9$�:$�Q$�Q$eS$)T$�T$63^$�^$9a$�l$�m$}r$�r$qs$�s$�y$�z$�$>�$^�$ł$N�$d�$Յ$�$s�$Ɏ$E�$��$/�$T�$�$��$��$+�$q�$"�$��$�$�$5�$�$�$?�$i�$~�$��$z�$s�$#�$]�$��$u�$�$��$��$��$.�$x�$��$^�$��$T�$��$e�$��$��$r�$��$D�$��$��$�%@%�%]%k%�%%;%!?%YB%�C%GF%�G%dI%�I%�J%�K%�M%(Q%LT%�U%9V%El%|�%s�%��%��%Ù%ݛ%��%Н%|�%О%�%��%[�%r�%��%/�%��%��%��%/�%׭%��%�%|�%��%��%64�%z�%a�%��%��%��%�%��%�%(�%��%O�%��%�%��%�%�%��%��%��%��%3�%M�%��%&�&y&�&(&J&#&&%&;,&-&.&�/&O0&�0&2&(2&�2&!4&m4&�6&�;&�=&C&�C&D&�D&AE&nQ&R&WR&�R&�R&AT&X&�X&Qa&�c&�f&�g&Sh&�i&,n&o&oo&6p&�p&*q&�q&�s&t&u&�z&�{&�|&�&��&$�&�&��&�&ߒ&a�&��&��&r�&R�&Ԥ&��&��&��&D�&��&�&ݼ&?�&��&6�&]�&��&��&��&��&'�&��&65�&��&	�&�&{�&a�&��&��&�&<�&��&�&=�&7�&`�&	�&��&��&��&}�&R'
'�'W''�'5'�'$'�,'�.'�5'�6'�6'8'<8'A9'h='B'�K'�R'�S'�U'�V'|]':_'�_'�u'�|'�~'�'��'�'��']�'��'M�'~�'��'��'�'͗'��'�'��'��'1�'��'J�'��'�'��'��'��'��'��'��'��'x(R(�(�(v(�(I((X(1(I(�(>%(�%(�)(�/( 0(1(�3(`8(�;(�=(>(�B(eC(�F(*H(YN('O(!Q(hQ(/S(�Y([(�[(�\(�\(�t(�u(��(ެ(V�(�(��(Ҿ(T�(�(��(%�(��(��(�(<�(��(��(��(��(�(��(��(��(��(��(�(��(@�(C�(��(��(��(��( )�)>)|))	)#)),)�)�)T)�)�)� )�#)�')2()�0)p1)/6)�7)�7)�8)L<)�=)5>)A)@B)kD)�J)!L)ML)N)�N)�P)/Q)^Q)�Q)�R)'T)�T)�U)�U)�Z)S[)Md)�g)�k)l)m)_o)$q)�s)�s)})=~)�~)��)��)=�)|�)��)��)T�)��)�)��)I�)�)/�)M�))K�)ԣ)�)��)Ѫ)��)�)��)��)ϸ)ͼ)��)��)=�)y�)��)C�)V�)�)��)�)��)��)k�)��)v�)$�)8�)C*�*s*K*8*\*!*:**s*�&*�2*�6*�6*98*y<*�<*�>*@*�@*�@*+O*�P*�R*zS*0U*W*�Y*[*Z]*�]*_*a_*�_*=d*�g**q*�r*�u*+w*�x*�x*�z*̦*�*��*)�*��*��*K�*�*��*�*��*��*>�*f�*i�*2�*A�*��*~�*��*B�*;�*��*��*"�*p�*��*�+�++�+�+t+�+66+T67+�+K++�+~!+A%+�'+�(+:*+r/+�0+m1+�2+�5+EN+|P+�Q+T+�T+�V+�Z+'\+f\+�a+�d+g+�g+�i+�j+�k+�m+fp+�p+�s+�u+�v+�y+}+�~+�+��+��+]�+͉+E�+N�+��+1�+~�+��+��+��+k�+��+Ϲ+�+��+��+T�+ٽ+E�+��+F�+��+p�+��+��+B�+��+�+y�+h�+��+|$,D%,�%,�&,�',68+,O.,0,q2,2,�2,�5,�6,
7,�8,�9,�A,�B,xC,�C,�C,AE,)G,ZI,NJ,�X,Z,�`,b,�c,�g,1~,�~,U�,��,5�,E�,?�,V�,��,��,��,-�,�,:�,v�,��,ä,�,۩,��,��,��,��,��,M�,	�,<�,>�,��,��,m�,��,69--�--�-�-#-e-�-y-.-<--�-�%-�1-�2-�3-�4-);-70<-%=->-?-~A-�B-�G-�H-LK-6N-O-~^-q_-I`-�c-�d-Vf-�g-*h-gh-�h-|i-^l-gp-�p-�q-8r-ys-Cv-�v-�v-x-�y-�z-)�-ȉ-��-��-&�-N�-��-O�-
�-ܛ-5�-��-�-��-*�-��-$�-�-��-��-��-��-Q�-?�-��-��-�-	�-+�-��-�-��-J�-�-��-��-y�-��-0�-��-��-��-��-��-'�-(�-X�-n�-$�-��-�-�...�.�._./.C.�.�.�.İ.Ʋ.��.��.|�.��.��.��.#�.��.��.&�.+�.��.�.��.��.��.=�.��.��.��.��.��.��.�/�/�/&/�/�71///�//�/A"/�"/)$////�4/�5/j7/58/�9/�9/�>/#?/TA/kD/;G/�G/�H/MK/kL/<O/�S/�U/V/�V/W/�W//�/D�/F�/#�/�/��/��/X�/�/��/�/2�/��/��/?�/m�/"�/��/4�/��/~�/1�/H�/��/��/s�/��/5�/��/��/��/6�/��/�/��/]�/P�/��/M�/��/v�/��/�/��/S�/!�/��/��/<�/o�/��/�0�0�0�0E0�0q0�0&!0^(0@+0=-0�.0�.0�/0o0010�10�50y60�60�708:0|;0E0�O0�U0�V0�V0�[0q_0�g0�g0�y0&{0�{0~0?~0l0�0H�06�0��0�0y�0�0q�0R�0#�0d�0��0ǡ0'�0�0'�0c�0�0��0U�0�0�0��0��0��0ʹ0�0[�0��0�0��0��0Ŀ0P�0j�0��0k�0��0M�0��0��0L�0��0�0;�0��0��0b�0��0��0s�0�1r1�1P1�1�1�	1�721�7311�#1//1�1121�21�21R31J51wA1�A1�D1�L1^R1�S1VT1�[1w_1Qw1{w1@y1�{1`�1��1��1�1��1/�1Ќ1O�1��1�11�1Ř1?�1j�1��1%�1�1A�1�1��1��1>�1\�1��1P�1��1��1��1"�1�1R�1h�1Z�1��1�1	�1@�1��1�1n�1��1��19�1]�1.�1g�1��1��1�
2�2x2[21262�2�2�2�2�2�2&2}2�2-272H72�72.82�B2XC2�E2(H2:K2�K26L2cM2�M2�S2qT2LX2&_2�_22`2?c2�d2�f2Gg2Zh2�h274i2"l23l2�o2�r2s2�u2�u22r2�2�2��2g�275�2t�2��2o�2�24�2T�2��2�2f�2ڴ2|�2ö2��2�2�2>�2ӻ2�2��2��2C�2��2@�2L�2��2B�2$�2j�2��2w�2��2��2��2�2��2��2P�2��2��24�2*�2w�2�2��2�2h�2��2��2��2�2L�2�2f3d3O3�3�3f33C	3�3Z
3u3�3�30O3@Q3�Q3\Y3�Y3�]3W^3�^3+_3�_3<`3m3�n3o3Zo3q3��3��3J�3&�3Ƥ3��3(�3L�3��3��3�3��4÷4�4ݸ4��4��4g�4'�4��42�4d�4�4D�4�55�5�55�5�5�5�!5s"5&5�&5�*5�-55/515�15�35155I:5;5�;5!D5�F5CG5FH5�]5q^5P_5�_5n`5bh5�i5�j5<k5�k5r5�|5k}5^�5�5b�5��5��5��5�5��5P�5ԑ5�5��5��5��5v�5�5h�5�5��5r�5��5>�5T�5��5M�5S�5��5y�5��5#�5��5��5��5��5��5��5{�5��54�5��5��5��5,�5�96}:6K<6�<6A=6?6�?6=B6�E6oM6�M6�N6P6�Q6PR6�S6�T6�U6X6RZ6�Z6�\6�^6�^6�b6Uk6�k6�o6�p6�q6l�6��6}�6b�6��6��6��6U�6��6ú68�6�6��6d�6^�6