Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00098_00000_shuffled.ds.index59 linesDownload Raw Back to root
1�!�}��	p���T � �!E"�#�%y&�&z'�()%?�FG�P�Q�Q�R�S�T9W�Y4Z�Z�cd�ef�h�s�st'v�v�w�|��K������1����~�v�R���`�v�A�����z�i�����������,�[�g�����6�7�����9�I��p����� �����O�������������$�����	l2R��
�A4A�I�J�P�Q�R�SpT�T�W6YZr[H\�\�_A`�`�`Kc>d�d�d6g�g�{�|�|r}~l�e�|���Ҽ�/�����P���	�v����5������������s�����4�����i�����3`(P�_��I�!�"I#N&b(�(G*�*+/�1�3%4�7;�<�AB=CD�E�F�G�I~�E�y�n��O'[t^_�`�aQc�d6wGwyDy�y.z�{�|���(�?����v�.��B�e�6���������3�%���B�����4�/�>����W����@���&�6�������!���������������/�l������z/C����L����+�Ʒ�:�j�v�4������A�J����������,�t�������\��!�+,/.�.�3f57�7P8R9�9�:=<�=lW�Y_�_�`sa@b�cZg�p�q�sStx�{I}ހ��э��#�����G�`�v�u����|�����e���0�����C���˶��M��N�`������,�c�����u�|���e�������e�2	�	U��"u�q�g�����	�r��������������X�G�`����� 	�	�	{5	�6		�
	�	}	�		k	� 	� 	4"	&	h&	�\	:]	�]	�a	�v	9w	�y	~z	��	7�	a�	�	��	ב	��	�	��	e�	0�	��	�	��	S�	��	N�	Ш	3�	{�	b�	��	��	�	s�	7�	ƴ	��	]�	��	V�	�	1�	�	��	��	��	��	S�	��	E�	l�	��	��	=�	��	��	��	8�	��	��	��	2�	��	*�	��	��	�	7�8�9�10a11 12�13
14�1516�17I18�19a20�21q22&23'24�(25)26�227�;28i=29�>30�>31(?32��33�34��35�36��37��38;�K������������#��r����H�39?S^W/b8�8�9�:�Y�Z(\_�crd�d�e�l�pr}�~�����i�T�?�T����k��
�
�
40"
8"
U"
�"
1&
8(
 /
1
�7
=8
�8
�8
�<
�A
F
�F
9G
�G
�Q
`S
�S
9U
Y
�Y
PZ
�[
^
�y
��
��
�
ԛ
�
��
ۣ
y�
��
%�
Ѽ
۽
��
p�
41�
m�
{�
�
��
��
';n��	b42�
RS�"�(�9?o�")%j%
&-&�'�)m*�.�/�/e2�6vLuX�Z[\�\�\�]X^�_n`#eh�h\i�i�lMm�n(o�o����Ȋ��J�ޓ����,���'���e�[���c��u���Y�Z�������������0���s�i���D��Q����"+�+d-�.>/ 3�3�6T7;F<�=/@�BC�D�V�\;_b�b�ftg�kdn�nQp�pst�ǏL�-�)�2���2���������ң9��E��W���ڬ �p�۷$�p�˿O�:�7�e�H�����j�
��������4�f�	�=�*�D�C������>�@:E�F�H�HKnK9N,P�f<g�gFh�hZi�i�i�j�m%o���!�Q�ċ��B���Z�<��\����2�����`��������������.����������2�����}���������w������������G	43W&�'�0 � �#U$�$+p+^,s4�5�60@+FI�J�KoL
M!Q�Q�TWFY�[9\�\s],^�_�_a�b
c�k>l�|}�|���E�X�����՟���������������`r�h %#&h1f2355r6�7�7�8�:�D�D�FxInU�U�U�r�s~t�u��Юݮ<����ڳ#�̵��=�*�p���#���2�����������<��I�[���(�DAEoGzH�YZQZp^�^�bc�c�d�d�e�h5j"k�m�m�o�o�44�
<yj����z_�� � 2$�$&%�';=<$=�=�B�CGK�K�L�OaQ�T�V�WhY6Z�\�k-m:o�olq�q�r�tFx�x:y�y-{�~?���ق�������7�Y����w���S��������e�v�Z��M�.�����8�����[�'�j�f��}�O�=�z����45*46d S"�"�#�(�)�+�+p,�,6-�-�.L/�8S9%;{<�=y>�>ZA�A�R}S�U2W�^�fthqi�i�ln�n��ƈA��N�ď�<�������q���T�j���4�������2�w���̾U�����H��������-�������]�.��	�47?
�O9Z}"%2*�+k,�,x4�5�6O7�7/8�89J;�;?@�@�A�E*F0H�HS�:��"';(�)!,�.133�4�5�6B8�?�G�HMRn[]�a.bgi�i�kRmsp	y!y�yf��?�!�:�ߒe���4�x���j���U���4���ȱ���������	�W���6���8���7�&R'�'+)�)�+E,f,�,�/�0G3O5�=�A3B�CME�E�G�L`Bab�b3c�c{e}�s�δ������ܻ�����e�����������6������������c�����4��	#r�#�$&�&�''+�+I,./�/:01�1X4�5�8�8U:�FGaGvG�I�IJ�OiP�SVdgqgri	j�kal�nق҄;�������<�����a�m�����R���4����N������������U������������2�5����z�������=���L � q  a b � � � S �  " h" �2 u3 +4 f4 ^8 �9 M< �< �A �A xB �H cy �z { n{ �| �~   j� j� Ɓ � D� #� ͋ �� �� � h� � � %� m� �� b� ]� �� �� n� в ø й  � �� �� 8� � 	!�48!�49!�!f!^!C_!�_!�a!d!�f!�g!Kj!(l!Om!�n!�n!o![t!�w!cx!Jz!�z!�z!#{!~!u~!�~!�!O�!*�!+�!��!�!��!�!O�!є!��!֠!4�!4�!��!%�!9�!��!��!e�!��!^�!m�!�!�!�!�!\�!��!��!
�!#�!]�!��!��!#�!_�!��!>�!��!#�!��!��!
�!��!��!z�!B�!��!��!��!z�!3�!��!n�!��!;"�	"r"p"["�"�""�"N"�"�"�"�$"p%"q("�3"�7"�D"�I"J"�J"�K"�L"�M"�N"�s"}"e�"D�"+�"E�"Ո"��"n�"|�"50�" �"��"�"]�"��"�"��"ޭ"P�"�"��"�":�"'�"��"��"�"0�"��"x�"G�"h�"(�"�"��"#�"��"4�"`�"��"��"�"^�"��"�"�"M�"��"P#�#�##�#
#	###c#g#�#z##�#�#+#�+#C-#-2#3#�3#k5#�5#*e#�e#�f#�k#\n#\o#�t#�v#�w#dy#�|#R~#�#�#2�#��#K�#~�#6�#S�#��#�#��#��#��#��#��#��#z�#��#]�#�$�$�$�$�$�$�$�$$<$/$]$$�$$`!$$$%$q%$�%$.($�($�($�1$3$�3$[4$�4$c7$�8$�8$9$;<$�@$C$�K$%M$yM$N$PO$�O$�P$hS$�[$w\$�]$_$=_$�`$=b$-d$�d$�d$�d$�e$�e$�g$Nm$Qn$#o$�p$�q$0s$zs$w$�$�$��$\�$Y�$�$+�$�$��$�$ϫ$K�$��$X�$��$P�$+�$I�$��$<�$a�$��$��$��$^�$��$�$��$��$i�$��$��$H�$��$V�${�$2�$��$��$h�$7%�%�%�*%�0%~3%�3%o5%�5%�8%,:%�;%�<%�>%�?%eA%�M%�Q%Hb%jb%�d%\f%�g%4i%6j%;k%�k%?m%�n%�}%��%�%%�%��%+�%s�%�%D�%(�%��%�%��%8�%�%�%>�%��%ܟ%�%�%��%�%Y�%z�%ӱ%��%)�%
�%]�%{�%�%��%��%ȿ%&�%�%��%��%��%e�&��&��&�&n�&��&d�&��&�"'�#'%'�%'�%'�&'0''�''�9'�:'I;'�='a>'D'�D'�E'F'lG'�G'�J'�K'/L'sL'RM'�e'�e'�f'l'�l'=n'�n'qo'Kq'mq'qq'Us'cw'Nz'}z'7{'1�'}�'��'[�'�'1�'��'��'9�'�'N�'��'��'ء'��'V�'M�'��'��'��'1�'�'P�'��'��'��'�'��'��'��'��'f�'|�'�(�(�(@(�(m(�((�(q(� (� (P"(H#(�#(&(z'(�'(�((�6(V7(9(b9(�:(�;(TV(�V(�X(uY(&`(`a(�a(51b(�b(e(Ae(�e((h(�h(�i(�j(�m(�n(�{(�(��(��(��(�(��(|�(��(	�(��(52�(P�(��(��(&�(L�(��(A�(53�(��(�(w�(��(0�(U�(�(�(�(6�(�(��(��(�)7)�)m)�)&)�	)�54)�
)<)p)R)z)�)�&)))u*)SL)�L)�M)+N)DR)�R)�R)T)�U)�W)[)�[)�^)�a)hc)�l)=m)#o)[o)�o)�o)Pp)�p).r)�x)�y)B~)�~)�~)V)�)�)��)U�)��)U�)Ň)��)Ӊ)��)��)�)C�)X�)��)V�)��)6�)��)-�)��)|�);�)@�)�)�)�)N�)׾)}�)��)��)w�)��):�)��)u�)%�)��)�)��)��)Q�)M�)�)��)*P*�*u*|*W*�*�#*b%*�%*�+*d,*�2*3*O3*�3*�4*sK*_L*�L*CM*�M*�N*O*�R*RS*�S*kT*�X*1Z*�Z*v]*x_*a*Of*�f*�f*i*�k*�k*�k*�k*�n*co*�o*�p*r*Iu*&v*�v*�w*�w**z*��*��*��*'�*Պ*�*d�*��*�*��*�*v�*��*��*��*ܛ*��*��*-�*��*4�*��*8�*��*��*H�*¶*?�*<�*I�*��*��*F�*q�*H�*��*�*Z�*��*,�*�*p�*��*o�*��*0�*��*��*+�*��*'�*��*��*��*z�*v+�+-+�+�	+++/ +[ +!+L"+b$+�%+�%+�&+�)+�)+�*+Q,+.+0/+c0+51+o8+�8+�9+_:+�:+<;+�;+j<+a=+�=+PC+;E+�L+�M+WQ+;T+}U+3W+}W+N]+�]+�]+.`+n`+<�+��+?�+R�+�+#�+ݙ+Y�+�+|�+֜+P�+��+��+��+��+J�+��+M�+#�+J�+��+*�+A�+��+��+Z�+-�+p�+�+�+3�+��+��+�+��+a�++�+��+��+Y�+�55,O,�,|
,�,�,�$,�%,<&,�',?*,6,,�,,�4,�?,:@,�B,�L,�M,�O,�R,.S,�S,�U,<X,gY,+^,Z_,F`,�`,b,�b,�g,>k,m,+n,�n,;p,!q,dz,��,΃,C�,s�,��,ג,N�,��,��,��,�,�,0�,ݬ,v�,�,+�,E�,�,L�,q�,��,��,��,��,��,�,x�,��,��,��,+�,s�,��,-�-H	-�-Q---�-M-�-�--8-u-�-b-�!-�!-~"-�"-##-H'-�'-+*-y*-y+-�+-�/-�0-$7-8-�:-�B-�E-G-�H-�L-�M- N-�O-�U-c-cd-��-��-?�-�-�-p�-��-��-��-�-�-1�-�-��-e�-˾-�-�-��- �-��-�-p�-��-�-C�-�-w�-��-��-��-�).,1.�1.C7.�9.9:.=.s=.�=.B.�B.�F.�I.�J.�L.�L.�M.�h.�l.on.�n.h�.��.�.s�.x�.ڕ.>�.�.��.+�.�.��.q�.�.@�.ڥ.~�.��.�.&�."�.b�.w�.��.��.s�.��.5�.j�.��.>�.�.�.��.y�.��.��.:�.[�.��.��.U�.��.��.j�.��.��.d�.\�.z�.��.��.B/C/�/�/�/6/d8/�9/�9/L?/|?/�?/~@/8A/B/�B/�I/dM/�M/�M/JN/�N/�]/�]/�_/�n/}t/�v/�x/�z/;�/'�/r�/Ё/�/K�/��/��/��/L�/��/��/E�/�/��/F�/��/4�/��/��/��/7�/ �/^�/��/��/h�/��/�0�0�0m0�0>0�00�0� 0�I3J38J3VK3@O3 P3^R3�S3T3|T3.]3�s3�~3�3�3c�3��3�3�444�/4104,14>24Z34�44�54'74q?48@4�A4�C4(D4�D41F4CF4�M4aN4�N4P4r4&s4�{4<|4�~4~4O�4߂4�4Q�4��4(�4|�4��4��46�4��4��4I�4z�4�4Ġ4ݢ4��4{�4��4ۿ4#�4-�4w�4��4��4E5,5d5�5T5�565�5{5z55K5T5{5y5&5f5�5�5�58 5X$5�.5/5S05�;5�@5�B5+D5�D5�D5oE5KG5)M5GZ5�Z5�\5]5�^5`5l`5Rr5s5t5@v5C|5}5\}5\~5փ5ҍ5,�5��5�5�5L�5��5�5��5Л5�5b�5��557�5ť5W�5�5B�5�5Ҭ5��5*�5��5O�5�5��5c�5��5,�5��5]�5D�5p�5(�5��5��5��5��5��5��5��5��5�5;�5��5�6 6�6.6�6]6�6|6�6�66�6!6�6/616A26>6!?6N?6�?6�B6*C6�J6�L6�S6�S6��6/�6i�6%�6��6r�6Y�68�6��6��6"�60�6��6��6A�6��6u�6��6��6@�6[�6��6Z77U7�7�7�777�7�727k7>7~7]7�77w"7�"7�#7�%7�&7�&7!)7�.7�1727B37V87�:7�;7e<7�<7>7�@7�A7�A7C7�C7pF7�F7�G7�H7'J7\L7tS7 T7aU7�V7�[7 `7�`7&a7na7�q7s7�t7�u7�u7�v7uw7+z7.{7X{7�{7�|7h}7a�7]�7�7]�76�7y�7��7ֺ7I�7�7%�7�7��7o�7k�7�7��7'�72�7M�7D�7J�7�7#�7��7��7��7��7�7I�7��7��7<8�8�8?"8�"8c$8)%8;(8�*8�08�38�38048]@8NE8gF8�F8(H8�I8�J8�Q8�S8�T8<U8dX8#[8e8�e8�e8�f8�f8�h8|i8{k8�l8�l8�q8;r8(s8y8�|8�8J�8��8�8��8ܜ8��8��8F�8��8!�8[�8��8g�8��8��8H�8t�8��8��8�8"�8�8�8��8d�8��8��8-�8�8r�8��8+�8��8��8��8�`;�b;1d;�d;�f;Wi;�l;o;�o;Sp;�r;�w;2x;y;Cz;#�;�;��;Ո;�;[�;ϕ;��;�;k�;١;�;��;P�;��;a�;Υ;o�;ȫ;��;K�;��;58�;~�;�;l�;O�;��;��;��;U�;e�;��;4�;��;m�;��;��;��;;�;�;��;1�;��;�;��;_�;��;F�;��;��;z�;G�;O<1<<�<<&<�<|(<*<j*<�3<�5<�7<A8<�9<�G<`Y<�\<�^<sb<e<gh<�j<�j<�l<Vp<q<��<�<�<�<��<y�<�<֐<R�<Ӓ<,�<��<3�<��<��<ڶ<,�<һ<�<��<��<59�<x�<��<��<��<��<y�<!�<]�<��<��<o�<��<*�<