Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00073_00000_shuffled.ds.index106 linesDownload Raw Back to root
1y��e2�*
}"H��g!	;�;=2>�J�K�KM,NnOP�P4RVXk[|]�]�^�^`�dyg|j�jKnoqowpdq�q�q�u�vUw�w�}�}d~��������Їc�`���3���c�Լg	�	v�2\���G����O����'�RuS�SDT�T�XMY�Y\K]�]@^�f�j�opOpq�u�v�xsyuzB|�ň�$���U�����F�ڝ����%�2�į��|���C���]�i�>���"�z����I�����@�������.�}��>;B
G<L�L�N�Q S�SMXsGt�t"u�v�w�w�x�y,}
������������>�ȓ�2�ɚ3�T�P�6��������l���5�����Z���X�=�o�c���*�����7��������r����N�b\��	D�JZ)%�%%)�)�,7-)738�8�8Q9^9?cA�B�C|D�D�GqH9I�I�I�J�KXL�NR�R	SOSNT�T;UWDW�_`Ifg�g�ukv*w�wxVx�x�{��`���4�k�-�=��A�������7�b�����A���;���1�X���^���n���'������������������J����3�[(�!m"�+R-�-�/�0
EH�HjLM.V�V�W�f�o�qMt�u�w�xyjy�|}~�~���������̇Y�V�8�A�����q��k�:����N�ߤҥk�~�˧P��������������&�^���r�0�W���	2	�	�	�		f	�	f	�c	i	g�	e�	��	��	%�	s�	Ţ	*�	Χ	#�	ԫ	5�	t�	,�	V�	\�	��	^�	'�	m�	�	@�	b�	��	��	��	�	h�	T�	r�	��	��	�	�	��	��	�495-
6h78h910d11!12U13�14+ 15� 16"17�#18Z*19�*20�+21�,22*.23[.24Z625726Pf27�f28^g29�g30<h31�i32'j33Jj34As35|v36�{37"�38�39Ќ40L�41��42i�43 �44D�45r�46�47��48{�49o�50�51��52!�53�54��55�56��57ù58�59|�60�61q�62��63t�64-�65�66��67�68�69+�70��71�72?�73��74��75:�76�77%:78x79-Ms��5��\��ܑ��������a�̻s��������l�$������L�����i���b�+�������������������m�+���U})�Y�b��G��!p!�#�'X(�,.�.6/0�0�0�5�6V9H:o<>N>�?q@'|n|}�~809�81������܎T���#�M�͜d��m�E�Y�F�q���9�����������)���Y
U
�
82
Z
�
�

w*
�*
�+
�-
f3
�5
�7
o=
�=
�>
s
�t
�u
�w
�x
�y
�z
�|
Z}
�
Ѓ
8�
��
щ
~�
*�
O�
K�
��


�
i�
�
E�
��
$�
�
0�
��
��
A�
��
��
83�
�
`�
�
��
s�
��
o�
��
�
2�
s�
d�
��
<�
�
�yAn�X�iFr��� "�"�"�#�#<$�'+(�c�c�d�d%�q����>����S�$@�"�%&}&�&�(�(G.�=n>�>c@vGOU�U>WgX�X^�`�bLqq���Ҙ6�P��M�^�ޞ��m����7�z�ӥo���ix�xzz�{�$�p���G���
�>� �W���j�6������B�z�n	/. =��#�%�%&�'�)�,�-�/0�0@4�4�6�:/;<<>A_A�IJ:K�MUQ�R�S.TDU�V�W�XY Z}[�\4]�^_W_�i�i�j�k�l'o}p�s�t�u�#�Q�H�G���O������]���߷�����j�����[�m��������V��=�)�1���.�����_�o� ����Ih��P���a�MN%f&�'�(�;�<~>lW7Y�Y�[�[U\�^naIw�w(y/{6|�-�F������ܐ̖%��˱[������g�}����_�������m����������x���#���/�R���Q���B�����9�����?�	�m��Y�C��C���!"�"�#�$%�&�&�+�.�/R0�2r4�4(6d7�9�:�:>;�;�=?�?�?�F�H>I�JjLGN�O1Q�Q�SJT[THV�V*W�Yo[E^�`�afd�ei/lo�p$qˀ�|�ֆ$���S������[����a���R�v�'�V�ȱw��7�ѹ1�W�p�|�������3��h�o�	���84������P�u�85�&�@�I23�I�O�QsS�SIV�fg�m7nLnU~�'�����_�86�i���é\������������ų=�F����u�9���|�8�����*�[�b���K�������687����� �%�SU�UWH\�\\]+^�^@_�������e����+�����7��A���x�Ы�����������$�r���Q�����i�{�������8���N�{�g�*���88���~��,�������W����k<��	�89	GB�}B������m&�&0�2�5�;L<�<�<[BGXJ�J�J}K~L([t[��>���j�e���X�/�R���=���y���.���r����~>�"#{%�%k&(�F�G�I�NFTlUBVY\�\�`oaWce�e(g�h�n`o�p�q�qGv7��/�a���R������������Q����&�0���ֽ<�2����'�(�)�*&+�,{2903�9M:�;-A�B7D�D�F�FYH�H`JpY,d�n�q�~���5�Ӈ�Y�1����z���j�����/��'����G���2��@���F������]� ��91�JBK�M�NIP�R�RU�V�hi�i�i*j�l�nMo�o�vU���S�5�Օ����n�����o��L���"���^�p�8�ĺb��-�v�7�}���V�~�����F��&�����?�����X0�� � l(�,�-�7�8�8;@�A)ETFhS�SOTfTVuV�V�V%WX>XuY�\�\}^�_/`�a�b�ghi�jGm�r`s�s�v�y|H|�|�����W��M�Γ�ŝ���إ�~���z�������i�r���������;�V������QNi92�93�94�95� �"�"�$y'�)�+=,w,�,�-�7�8�A�BC�GZH�HQ�Q|RkT5V'YTY�Z�[�`�f�g�h<o�oNp�pStuwux:{�{^}����nj�Ǝ�����Y�)���ߪ7����ϰ������Q���e�����y�������g��8�u���z���������/�����_������d���RK./�3�5>6VE�EI�J9K{Y�YcZ�Zfr�s:tgt�t�v{y{�{�������w�`�4���!�������9�m�����3���d�Ʊ��X���Y�K����������������5�����"���J�F�%��������K�n�����������4�B�^�/���9���b�����& t R � � �& B' �' * I+ 2 �4 �4 �5 u; "= �= &> �A �D TE �E �F �F TI �I �I @L M h �h �k �k %p �p r �r �s ]z � �� {� E� ɇ 1� �� �� <� �� B� � �� � s� �� � [� S� �� <� +� "� � `� g� D� � 2� �� d� �� �� �� p� �� �� �� �� �� M� �� 	� �� �� B!B!�!)!!�!$!K
!�!�!(!�!!�!F!�!�!:!�1!�7!u8!�9!�:!z;!>!@!�D!R!uj!�k!/m!�m!�n!�o!�q!s!�u!v!=x!f�!e�!�!A�!��!��!/�!|�!��!��!�!�!D�!�!X�!`�!��!q�!b�!?�!8�!»!�!��!m�!��!@�!��!X�!��!��!@�!+�!U�!
�!�!2�!h�!�!�"�"�	"$96"="p"�
"�"�"�"�"="""r"�"g"-"�"$"U"�"�"-""v#"�$"7%"+("�)"�,"-"C0"G1"�2"4"q7"@8"�8"_O"9S"�U"�U"�V"Y"]Y"p\"�]"�]"��"$�"$�"��"�"	�"2�"��"S�"ʪ"Z�"��"�"J�"Ů"��"�"�"k�"c�"��"s�"I�"h�" �"�"0�"��"�"��"��")�"��"�"��"c�"[�"��"5�"�"[�"}�"]�"��"��"��"�f%6j%�j%�k%��%*�%D�%ω%G�%ߋ%��%<�%J�%��%��%��%��%P�%��%�%��%��%�%�%k]&�^&97`&Hm&:s&�s&t&�v&Jy&xy&�)�)1)i)�)�)v )� )	!)�")�")#)*�*�*O*�*�*�*c	*V*�*<
*
*,*4*�*�*�*�*E$*\$*�&*�/*�=*V>*�A*�F*�I*rJ*�J*DK*�K*98L*.|*�|*�*��*��*0�*�*^�*Ӌ*��*[�*a�*��*�*j�*ǖ*�*�*n�*֚*2�*�*]�*|�*��*��*�*;�*��*F�*J�*%�*��*Z�*�*��*��*I�*��*��*��*��*��*E�*��*��*��*��*��*�*��*��*9�*D�*.�*\�*n�*��*�+@++�+�+P+�+�+,+�+'+�+_/+R0+n0+�1+�N+%O+�R+�R+�S+�V+�_+�`+�a+�c+�f+Eh+�h+hi+�l+Gm+�m+Ln+�n+�s+t+�u+�v+�w+�z+�{+�{+�+I,�,s,�!,�3,(4,k4,�6,;,�<,{>,;?,�?,.�,c�,��,�,"�,f�,��,�,O�,��,u�,��,��,�,k�,J�,׫,o�,)�,L�,��,F�,�,F�,��,i�,��,]�,��,��,��,��,E�,��,�,��,��,R�,�99-]-\-�-l-�-h-�-r -�!-(F-G-OO-�S-ET->V-�V-�W-.X-Y-�\-�_-<b- c-�c-7f-|�.��.��.]�.��./�.��.��.��.��.��.��.�/�/�/?/�	/c/�/E/�/�/S'/�)/�*/�//�2/4/'?/�?/�?/�@/A/OA/�A/"J/�J/�J/�K/�N/�N/7O/100P/ Q/�Q/�R/*T/(U/�V/KX/�Z/�[/k]/�]/�q/�r/s/{v/iw/y/�/��/��/Ė/$�/d�/F�/1�/͝/m�/[�/��/۱/�/�/B�/q�/G�/@�/�/��/-�/|�/��/��/��/��/��/;�/f�/�/�/��/��/9�/��/_0	0�0�0f00�	0H
0�0S#0�#0�)0A*0O-0?00�10*20o6070�?0�@0�@0TA0�A0)B0+E0RS0|S0�S0T0�^0�_08`0ea0�c0Xh0�i0�j0�j0_m0Zo0?�0r�0�0��0ن0�0��03�0^�0ъ0܋0��0��0ˎ0��0]�0Ǖ0F�0͖0��0X�0��0m�0��0��0��0R�0 �0�0'�0��0d�0J�0�0�0r�0k�0��09�0��0j�0��0��0��0%�0��0��0�1�&1/'1r'1�*1�+1�-1�01�11?21g31�A1�A1�B18k1�l1�n1�n1�o1-p1=v1Hy1�y1��1r�1�1��1ղ1Z�1ij1�1Y�1@�1��1��1O�1_�1��1��1��1R�1-�1�15�1��1(�1��1��1��1��1��1L�1��1	�1��1��1\�1~�1�1��1_�1��1��1�1>�1}�14�1{�1��1��1��1��1��16�1]22�2�2q2�2�2�2/	2J2m2�2�2� 2#2�#2�#2�(2�+2QB2YC2�D2F24R2�R2X2!Y2�Z2@]2�]2`2<c2�c2�e2�f2xn2�n2<o2�p2�q2Ar2�s2�t2y2-{2�|2�}2��2�2��2/�2��2k�2�23�2܋2�2�2a�2ѕ2-�2e�2m�2�25�2D�2��2�2ô2��2��2ʷ22�2z�2��2��2��2\�2�2��2��2��2��2333�3&
3b
323�3�3�3�$3i%3�&3�'3[)3�)36,3p/3�73�>3�@3BR3�R3GS3�S3GT3�T33U3W3�e3Uo3[o3rq3�q3ur36s3Bt3�u3�x3#z3�z3�|3�}3�3��3101�3&�3[�3ڑ3I�3N�39�3Z�3��3'�3��3��3�3կ3��3,�3W�3|�3�3�3H�3d�3R�3�3g�3��34r4�4`4�4�4�4� 46!4Q#4�$4�$4�$4x'4)4f*4�+49,4�.4./4944O>40A4vA4kC4�D4�E4!F47F4�N4P4�Q4�T40U4tV4W4�W4nX4ib4qc4;d4�g4�g4�j47k4�k4=s4102t4T�4ϖ4l�4��4��4Ѡ4*�4ӡ4ӧ4|�4w�4�4��4��4q�4��4�4��4103�4V�4��4W�4��4��4��4��4��4��4g�4��4<�4]�4��4�4�5�5N5�59D5�D5�D5VE5�K5JL5�N5O5,R5�S5�T5�T5V5_W5EX5cY5�d5[i5k52l5Rn5p5�q5�q5wt5�u5�y5�5�5'�5��52�5ӡ5��5E�52�5��5104�5��5��5ɼ5�5ܽ5d�5�5��5/�51�5��5�6�6�6�6Y"6�.6@C6�C6FD62E6kE6�E6,N6�P6KS6�S6U6'X6�Y6�Y6�[6�]6�]6Hl6�l6݊6�6$�6�6�6:�6�6�6q�6�6o�6)�6��6Z�6Ī6C�6��6��6=�6��6�6x�6��6j�6��6̼6<�6U�6վ6&�6n�6��6�6o�6��6��6�6$�6��6�6��6,�6q�6"�6��6&�64�6{�6��6��6I�6U�6��6��6��6��6�7�7>10577^7�
777]7T7�7�7�7-7� 7%7U&7w&7'7;'7{'7�'7	H7&X7nX7�X7Y\7#c7�c7�f7�m7n7�n7o7�v7dx7|7�|7>}7y~7��7�7V�78�70�7��7��7��7-�7�7خ7B�7�7��7p�7c�7�7̽7�7j�7��7)�7�7��7D�7��7>�7��76�7�7R�7��77�7��7$�7�7�7��7��7�7�8O8	8�88�!8�!8�:8T;8W@8�J8�K8_L8M8]O8!W8#X8�Y8�Z8�^8�`8a8�b8�d8�j8�j8zl8cn8�n8o8q8p|8�8V�8�8��8ݓ8��8t�8�8ј8�8@�8Ҧ8�8��8(�8�8Q�8K�8�8N�8@�8�8D�8��8��8;�8{�8�8[�8��8�8�8��8��8��8��8!�8O�8��8��8��8�99�929$9�9c9w9�9�9�"9�#9�#939�49�69�7989�C9�C9D9�D9�H9:I9/J9�J90P9UP9�P9�Q9tS9VX9�Z9�[9�d9�t9��9�9Ԫ9�9��9��9��9��9��9$�9n�9��9��9��9P�9��9f�9��9��95�9��9#�9��9��94�9��9a�9��9��9e�9��9��9�9-�9��9,�9Y�9��9A�9��9��91�9��9�:�::�::106:�:�:�:a:�:b:l:�:�:f:�:�:�:2:]:\:3!:�#:R$:�$:�$:�%:�&:N':�':J):�):�.:�6:&7:�7:+8:~8:�9:::