Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00037_00000_shuffled.ds.index112 linesDownload Raw Back to root
1Z4�2���
��'� !x#�+�,�0�EcL�LN�NCO�P8QZ7[�^�^�`+ptjw�zi~�����s��2���?�������$���������9����I���4���y���a��
8�Yc^�~$�$�%4'�'X � �"�%�.E9E=I�IRJKO�OQ`S�T�V�W5Yf;f�fWg�h�i�n%o7o�r�s�sGu�u�v1~�~�ح������?�e���4�=����������d�����������{R�3$��>��.�p�!V%�%�&�'�*.+�+�+�/�1�2O5�7�8Y<�<=�>6@�@GAC�C�R�WEe�e
fJh~hi�j�l�oRp�pq�q^t�y~F��߁������W���9�f�7���ۧ~���֬'��E��>�c�����e�����������������o�����?����&���!�	|�c�?Gt�X�/$�%=)�),�/>0F3p3[4�8D=O2P#Q�Q�T�UqV�W�W0eh`k�k~l�l�m{�"�|�ԚH���t���`��+��_����������4�K���%��B
��4%t�e$�$�H8I�J)NO�OOtyt�t�v�w'~�����f��� �t�Z���¾^�������A��������������r������(��	�%W����
�
�A��Y� %�'+�,u.�9�9�:�<�?A�BCRD�G�H�J�K�L(M�M�N9PXP�U�V�l^m'n�n�pFu3y:z*|� �l����2�]�ܖV���`���~������9���?�S�����4��L��������ý����
�5����������������������.�O���U���1�5�"��)����Y��&���w��5�5�6o����U�������&�����n�������O�-�	�	Y�	E�	2�	v�	��	��	�	6�	�	'�	��	t�	۝	e�	��	��	g�	�	��	��	�	��	F�	x�	��	��	��	��	�	��	��	/�	��	~�	��	%�	��	4B5m6�7�8y9�10�	11�12�13-14\#15�#16
$17�%18.(19|)20X*21r*22;+23�+24�-25T.26�027�0280529�>30?31i?32�Q33�S34�S354X36�X373Z38�Z39<\40�\41�]42�_43�b44�f45�g46�g47di48�i49�j5051o52t53�u54Dx554y56�{57�|58~59@60�61;�62��63�64�65��66݆67��68ۊ69d�70��71p�72��73I�74��75=�76��77:�78/�79��80�81��82��83��84��85P�86cS�"87�88�/�
B	:���!�"j(�(�)V,h,�,-.�1�8�<p=?@B@�BEbGkH�I"J�JiN�N.O�O�P�P�c	d�d�e�f�f�i�i*j�j�kl�l�mQn�n�r�r�sOtfwN�u�y����F�ݗ��̟!�e�[�89���~���2�)���ټ�ܿ����9���{�
�3�w��9695:;;3;^;�;<�<}��(�Ƅ@���9����]�%�}��)��90���C����F�z�A�X�#�������?�q���3�����=���^�]�����4��������;���J�2�������
}
`
5
�
r91

�
�
�
�
D

�


&'
Z'
�'
s*
�+
�+
M-
�-
*0
k0
1
�1
�3
�3
�4
A5
�7
�8
�8
I9
>
6@
�B
�C
`D
�D
IM
N
{O
5R
;S
�S
U
�U
WV
�V
�X
[
a[
\
�]
�n
o
�
Ȳ
��
��
��
m�
�
�
(�
~�
6�
e�
<�
��
��
��,��l����-����!�%y,G--b.�.�7.:<�<�>�@�D�F\G=J\M�Q�TV?x�xy�{A���?�h�[���w�ۓ�V����������,����T���������92������93�m���q�E���F���s���N������_+u�����l�v�P4K9:Y:�;�;�<VI�J�K�K�SU6VLVQWY�`aSbTc�c_d�e94s�}�����·�H���95����%�B�������:�2�����S�B�E�M�]���&�z�:�2����I�{��`w��f�7W�(�)+-T/�/�2`5=6�7�77=�=>>�>�BCI_IJL�LNN�N�^`caMb�c�m/n�nKp8r�r��B�҉��č���b�����f������Q�y�����G��������S����96������697�X�;�u�N�B,#s#=$(l*�*.q0�1�45Z>j>>?lA�AG�GJK�KeL�L�V�V�X[^c�cgxp:r�rd{0~�~`!�x�4�T��y��y���(���>����ۚ����T���{����������6�5��
	��{���H�I�NaP��5������c�+���������>�������d����]�W���������=�X�e�4����������	�r���IK(�*-�.%68=!?�?2@�CD�D�FGG�GM�r���������\� �N������������������J�������B�G���q��������������q������������������3����98���q�s�tfL�X!�"�-�/Y0�7�@�A\M|P�W�[4\U^�`�`/a�boc�cz�zr{�ނ„őߖk��ǰe�G�(�����g��������d�����p�eK��
.�Y�[�fl�l�l�q�r}tVu9v�xRy‹��t���������������<�ز���n���ɸ�;���S�������E�����������V���n�u���w���� i Z T � ^ F  �$ % ' �- �- C0 2 A2 �2 r3 �3 �7 �8 �9 (= H �H �H tI MJ �J �V X X �X �Y �Z ^ �^ 8` �d ?e �e k tn �p �s �t �x :� �� �� /� �� �� !� �� ,� 	� җ 8� � ܥ � r� � g� �� ׮ � ۱ � Q� j� � 1� P� #� <� [� �� {� �� �� �� �� h� Z� �� �� q� �� l� � �� � �� =� )� <� �� � `� �� �!3$!�$!�$!)'!,!8,!v-!&.!�/!N1!2!#6!;!~?!�?!A!1A!�A!`B!`a!�a!ge!�f!�i!�j!�k!�n!wq!�s!Bt!ox!�x!�y!�}!7!ۉ!��!Œ!O�!�!��!7�!��!x�!��!��!h�!S�!��!��!��!��!+�!��!�!��!T�!x�!1"�"�"�"��"Z�"��"��"t�"M�"��"��"��"/#Z##:#n#_#99#�#�#5'#�'#(#�(#�(#7)#N-#�-#�0#�2#!3#�3#C4#7#&9#�9#:#�<#]=#�=#O>#A#�A#�A#E#�J#.Q#kS#f#�}# �#̂#�#É#D�#͙#q�#��#�#`�#100�#��#ܥ#�#�#{�#3�#�#��#�#��# �#�#��#.�#Ƿ#�#s�#�#Ȼ#\�#Ҽ#p�#1�#=�#��#i�#��#��#��#y�#&�#��#U�#��#2�#��#��#1�#{�#A�#��#�#��#��#��#��#�$�$�$;$�$$�$&
$_
${$�$*$�$�"$,-$�-$�0$�2$3$x4$�4$H8$�=$�?$�@$�@$�B$�C$�E$ F$@I$�I$MO$wO$7P$�W$�Y$@^$�_$^`$�`$�`$ta$�b$"c$^c$Gh$�h$�h$em$hq$t$�t$101v$�x$yz$�z$>{$n|$F�$K�$m�$	�$:�$�$+�$X�$��$�$$�$0�$_�$��$��$�$�$��$��$ک$��$$�$��$D�$O�$8�$m�$A�$��$��$��$��$̿$��$~�$��$�$��$��$��$i�$�$��$q�$�$s�$+�$��$x�$��$��$&�$��$��$(�$��$��$2�$�$�$��$*�$��$�$��$��$i%x%%V%�%A%y%h%%p%�%�%4%�%6:%{:%�;%�<%�%]�%ˌ%;�%��%.�%��%z�%��%-�%��%��%	�%102�%��%��%�%M�%z�%��%��%{�%��%��%��%�%��%��%!�%��%��%��%��%X&U&�	&�O&6P&�P&�R&dS&U&�V&OX&iY&�Y&MZ&L]&qa&_t&[u&nv&�v&�w&�x&�y&�&+�&��&��&�&U�&��&��&c�&��&"�&��&+�&P�&��&�&U*w*I**�***d**�!*N"*�&*�'*�(*�(*o)*�+*M*�Q* V*8W*�Z*[*�[*X\*�d*�d*Qe*�f*�g*:h*y*�{*�|*X}*m�*��*w�*O�*
�*B�*ֶ*׹*��*��*��*��*P�*��*��*�*�*U�*�*��*��*��*��*!�*��*��*w�*Y�*�+S+�++�+^+�+�++�+�+Z+z!+�#+]%+�%+I(+#)+�*+++�,+�,+�.+>0+L6+1037+`7+�9+�:+�;+C<+�C+104D+7D+8E+�E+AJ+�R+T+}V+Z+QZ+pZ+p[+�[+\+�]+�^+105b+Cm+�o+$p+ys+1t+�v+Kw+�}+�~+F+�+��+��+<�+ˉ+>�+��+i�+��+ڮ+��+g�+ķ+��+��+��+�+��+i�+��+)�+��+�+o�+��+c�+Q�+��+�+P�+��+[,b,D,�,,5,�,�,,B,�,�,�,",�,�, ,/#,�#,�#,�#,s$,)%,g%,C(,�(,*,?,,�-,�.,�/,\2,:4,�4,�5,76,�7,8,8,�9,�:,[D,�D,�I,'J,6J,L,T,;T,�U,�},�},w~,j,�,��,i�,_�,	�,E�,�,c�,�,�,;�,��,�,h�,�,֟,��,��,�,��,[�,��,��,Դ,��,^�,�,*�,4�,+�,Ͽ,ڿ,��,��,��,��,�,�,��,|�,��,��,��,��,�,Q�,�,��,�,��,��,��,$�,m�,m�,��,�,=�,��,��,��,��,�-8--W-�-�.-�2-7<-�?-�@-!A-�B-�C-VM-�N-sO-�O-"P-�P-5Q-�R-�W-
Y-hZ-�[-�p-106u-�u-�v-�w-�x-[|-}-u~-�~-��-�-'�-�-��-�-r�-�-4�-��-1�-]�-ٻ-��-G�-��-��-`�-��-�-g�-��-4�-�- �-r�-#�-��-�-H-...3.�:.;.I.�J.HK.L.�N.�O.Q.�R.�R.,S.�T.Y.�\.\^.6_.a.�a.�d.�u.Vy.�y.�y.�z.G{.�|.R}.�}.�.��.�.��.ȋ.s�.�.1�.��.�.ԙ.^�.��.�. �.��.?�.�.=�.��.0�.�.��.��.t�.�.��._�.��.A�.��./�/�/�/�/�/�/2/�/�/
//T/�/�/�/=/�/�/�/�/+//�/` /�!/�&/L'/�'/:(/�+/,/l-/�//e2/'5/ </`>/�V/�X/>Z/�^/"`/b/�e/&f/}h/�h/�h/�j/bl/Bu/V/w/u�/�/x�/w�/��/U�/107�/��/�/��/��/ș/X�/4�/Q�/l�/'�/��/0�/��/e�/��/Ƹ/G�/w�/��/-�/��/��/��/a�/��/��/��/I�/�
0�
0�0�0�00S0�0B00 0q0�0#00�0* 0d!0h!0q#0�#0�'0*0�+0]90&<0�?0VG0�G0�H01I0�J0K0108O0�O0�P0�S0tT0�]0^0�^0`_0�_0�a07b0e0�e0�n0~0%�0ˁ0��04�0҃05�0&�0K�0��0��0��0A�00�0��0R�0�0Y�0��0��0M�0��0��0��0��09�0�0e�0E�0O�0�1�1�1�1$	1/	1�	1�1�1�11�11&1�1911�#1�(1f)1^+1<,1�F1kT1�T1dU1�\1�^1�a1�~1@�1C�1��1�1��1Ò1��1ݕ1|�1��1�1��1��1&�1c�1�1�1�1d�1��1��1c�1��1�1~�1z�1�1�1)�1��1J�1��1��1:�1��1S�1�1d�1a�1"�1_�1��1*�1v�1��1��1��1��1��1�2�2�2�2�2�	2�
2�
2K2�2�2�22�2�C2E2BG2K2�Z2�[2�[2�[2l\2�\2�c2�d2wg2h2�h2�h2�j2k2P�2X�28�2��2�A33B3�B3F3�K3/X3)`3eb3�e3of3g3�h3:j3<v3bv3�v3�v3�w3�y3�y3G{3�|3�|3-}3�3B�3��3��3h�3̍3��3��3ԝ3��3��3j�3��3o�3�3��3ݦ3u�3�3��3ڪ3�3��3+�3�3ʯ3]�3ݻ3��3C�3��3��3�3��3i�3N�3��3w�3��3y�3?�3��3�3.�3�3&�3@�3��3�3��3��3E�3|�3C�3��3�3%�3U�34�4�4�4R4�U4V4�X4YZ4�Z4�d4'n4�q4sr4	s4)t4-v4�v4Aw4x4ux4G|4~4�~46�4Ӏ4�4O�49�4p�4C�4��4��4Đ4��4a�4@�4��4��4|�4�4��4u�4�4�45�4��4#�4ɢ4�49�4^�4>�4��4�4��4��4��4U5�5;5�1095a5�5
5�5u5�55O5�5�5W-5�25�;5�;5�K5�L5�M5�W5/Y5�\5�\5�_5b5�b5�b5�c5sd5�f5+g5�j5�m5tn5>p5�u5d�5ǒ5��5�5S�5��5՟5��5R�5�5ԩ5��5ʷ5�5R�5�5v�5v�5P�5��5�5�5��5�5��5��5T�5��5W�5a�5s�5��5��5��556a6�6�	6�666z6�6K6�6	6p6�6x6�6�6 6� 6_!6�!6w(6)6f)6�)6�+6n,6-6g-6O/6D16!26�46�56266�76{86�86:6�:6;6O;6
<6E<6�>6�R6�V6dX6�X69Y64\6�\6>a6ob6�b6�c6�d6kh6�j6�l6�m6Ku6x6�{6R6b�6g�6��6ײ6��6�6	�69�6$�6A�6q�6þ69�6{�6��6��60�6c�6��6�6H�6/�6!�62�6\�6��6.�6��6��6�6��6��6��6�7�7�7�7-7�1107C7�7�77�7�7�7o7J 7[ 7� 7%7�%7�,7-7�-7�17>2737\47�47�57$77E87@:7 ;7>Q7�S7�T7TW7PX7�X7\Z7�[7h\7�^7�_7c7Sc7�c7Sd7�d7Jv7y7y7��7��7��7��7��7�7̯7ļ73�7��7�7��7��7�7��7��72�7�7��7��7�7�7g�7��7��7H�7�7��7i�7�8�
8x8�8r8�8#8q8�8�Q8�Q8�S8|T8�Y8�[8F\8�f8g8�h8!n8Tr8�r8�s8t8�t8�8��8�8�8��8�8��8�8ݢ8�8/�8��8�89�8�8\�8}�8�8f�8߼8�8O�8E�8j�8V�8��8a�8�8*�8��8R�8A�8Q�8��8��8��8?�8�8��8�8��8<�83�8��8��8^�8��8��8,�8��89Z9�9�9�9�11199�9&9Q$9�$9I`9Ia9�a9[f9�f9�g9Ai9�i9112l9�l9�n9�o9#p9Mp9�q9=s9it9#{9�{9A�9��9�9��9e�9ݚ9�9��9�9l�9��9q�9��9[�9�9�9��9��9��9��9}�9��9Y�9/�9��91�9��9}�9��9	�9��9��9!�9i�9y�9��9*�9X�9G�9��9��9�9��9��9�9I�9_�9t�9�9��9,,:F-:'1:�1:3:6:$7:�7:c9:�@:pA:�A:�A:�F:�M:YN:�N:;f:�h:�j:]k:�k:_l:�m: