Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00010_00000_shuffled.ds.index34 linesDownload Raw Back to root
1h
����%I�#	�	�2�
�	��<,-24�57T8G9�>A,C^E_H�I�K2MNO�O�QQU/WuX[Q[�[1\h_�`�cCe5f�j{lo�o-pZqt�t*u'vx��r����w��Z�N��d��� �0N1`2�2�4�C!F�NS�Sc��������^�ڻ���[������?�9�c���Q�����;�F�`�Rj�	�	h�o� 6��>,����+0,�7`8w8�>�?�?�@�G�HyJ\MU�U�ZN^dDnhnGq�viyK{|r|}����v�%�m����>�,��������#�������i�����H�ij����f�g������m�����}���m��t�h�^�������a��4���x�[��y��!�"�"�#>%%�%�&�';+�+7-8/31a1�1Q;(<�<8=�@�@�@�EfG�Q�Q�T�T�U�W#XY�Y�Z�Z�[d]�^�`�fiqi&o���҈�4�Q�b�#�k����z��=�|�3�>� ��y�?�
��������5�V����r��`�����W��������Q�^�y���������������Jy�4
�����Q����~�B�!"�%l'!)*�+0,9-�.x/�1"2~4�6w7�708�96;�<j=�=>T? R�R\TRW�W|Xa\k
�
�q��!K!�"�$*�0B4�45�9_:�<�AQB�HoR�U>X�[�[�\�]_9_h_}_p`�`@ad,f;f|f�gIh�oVq�q.t�!������ыӌ`�6������+�Ϡܡ��Τ��N��������2��������a�'���������A�z�5�_�Z����IS!H$�+,�,�,s-�-^2�65758==�=�>hN9P�P�QLU�]�^c�e�flgkk�l�nzazY{�{�|ˆ�'��2X-,�,"/�/0&1�C|G�GCI�KfM�����������"������ó���ܾ_�x�1��������'������������J�����Q���!�!G"�$�(�)�+,|-�-'0�0�1�2M3�3�7�7�;<OF%H�HHM�N�O�P�]1��΅����\�ʏӐْ�V�WLZ�[4]�]�ab�o�p�s�v�w�|s���D������*�ϊ�X�^�X�e��ž�<�p����"��6����������7�X_�� �!<(e:�>@eA�A�Q�R�UW4dyd�e�k�k�lQnxng{�~��+�������?�s�f�e�C��L�ѣ�����E�Z�D����8�u���N�b�6�����������	�d�Y���i��U��[�_�`�*���[�/������������a�s0����A.V�+��!P*+.�.d/�/�0{1�6#7EBI_KLUL�]^`ba�aqe�f�gmr7t�x�}�~B��U�_���4�{��x������e��1� K!}"#�&�& (m)�)�),;�F�F�G=HHK�K�S3T�TqY�ZQ[S`_yez�~���܇]���y�3�������|��c����^��)�������ү���6���иe����	��6���?��v�����b�*�$�'���C���,�����b�G���� p!�!�"�#$�$�%$*�*�3w46�6�7�89�;^<=�HB]g^�a�a�c.f�k	lm�pGrt�x�x�yK��_�����S�C��,��������ǑP���"�	��0��������q����/�c�u��� P"r#�$1),�,b-�-.0 2z2^6�6�EG�HHIWI�K�M'RVS0Z'_&a�apb�d�evg�g�g-j�j�j|m8q�r�r�s�tov'w7�5������<�|����p�8�ŗ)��<�
�>���4����������`�������������.�Y���t�p�n���� `"�"#�#�.645�>,EkE�G�UpX�Z,[�[J]�]!`�`a�a�a�aEb�g�nCw�x:{��G�����������h�������'���d�����;���R�>���������?���������<�Un��[�s�%J� �"0#H$;(T,�/m0�67F7�9Y;�@�AB�BQE�F�G6H�I�M$O�O�QqSW+]^�_adagc�c�d�gQk�n�z�zO}�}�~cȀ$��J�ԇD�u��������d����������V�����R�#�������F�����-�����b�A�6��M~���� 9g10>q
m	�vJbX��9�� �!("z"4$�$*9�;o<BJQS'T�T�U�c�dqg�pIqvr11sMTWEW�X�X]Yr_
a�a�b�f�f�gymn�o�r's�t܍��������(���d�8���K�t����%�����j�����{���������������3������12����������I#
$q%'�'(B.W7�8/9>8@aA�C9D�E�F�H�IjJ�L�O�PSVzV�V�W�b�c�c�e9f�h�jtptvov�wex�yz�z{/Ҁ����/�ψ��΋�8�Q�j����-�ȟh�����n�ͪ�������"�G�1���H�0�.����U�����W��������������������B�#o��#�'m3857�8�9J<�<�=^>�>�?�E�KFLiL�OPgR2YvY�]2_�_b_c^p�p�u�vHw9x�x~yt~�$���	�q��e�ӈ���ԋ��Ռj���l��t�Μ��ġޢN�����R�����������������8�"C�]U13�14`j!#E#�$15%�%�%P*QxQ�QRaRNT�eg�g�o�r�sgt�u�w�y7zc{���������ޒ���"��s�������16����n�B��������������Q���$�m�N�s�E�*�+r/�@LAdABpB�B�C�E#H^PSQ�`�`+c�d�d f�i�j�n3uNuw�}S�Ą9�C�V�T���p���������u���ȡ.�������f������|�g���������#���������"�q�����5 � � � �  # `2 ;4 W4 ]: KM N �N �T �T mV W 2Y z\ g^ sb ag i ;k $l �n Ao 6p �p �v �x �y �{ /} E} �� �� E� {� &� � �� V� �� _� �� j� �� A� � � 7� �� p� R� �� :� f� F!s!f!�!�!�!� !")!�0!c1!�1!�2!�3!+4!�4!�:!>!Y?!�?!'@!aB!�C!�D!hE!�Y!ZZ!_!Cb!�b!�h!xl!��!��!�!y�!�!!�!�!��!(�!��!��!�!Ⱦ!��!Q�!��!��!\�!4�!B�!��!�! �!��!O�!�!��!��!��!}�!M�#'�#�#�#�#��#�#��#�#~�#ݰ#��#ӳ#��#��#��#��#z�#ھ#>�#y�#��#�#��#4�#��#�#��#\�#{�#D�#��#��#��#L�#,�#��#��#�$W$-$�$$�$J$�$�$�$\ $I"$#$+*$p.$�1$�9$z:$z>$?$�B$17C$�M$�Y$�Z$	_$�_$ab$�c$�f$�~$O�$j�$��$\�$�$��$w�$��$̗$L�$0�$!�$
�$U�$ $m�$1�$?�$��$д$��$Y�$��$�$B�$�$�$��$�$��$[�$��$��$��$�$��$��$��$��$y�$18�$�$o�$��$��$=�$�%o%�%-%�%$%?%�%�%�% %t %�!%�!%)%�+%.6%�O%�O%�O%/Q%fU%�\%]]%�`%Oa%�a%9b%�b%�f%Hj%�o%�p%�q%*r%�r%`u%�u%4w%�z%�{%��%=�%F�%��%s�%&�%��%~�%��%Y4&�4&�B&
C&�C&WE&�K&SL&�L&�M&sP&Q&�Q&�S&�Y&�Y&�Z&�\&�\&�]&L^&a&�a&se&Hl&�u&��&��&'�&<�&��&$�&��&��&ͦ&Ȩ&��&j�&�&6�&��&,�&��&��&2�&�&��&��&_�&��&��&1	'|	'�19'�20'?'�'�
'b'x'�'� '!'�!'t"'�*';,'�,'R-'�/'0'�0'�0'1'�2'�2'j4'�Y'o^'�(Q(XQ(�R(XT(+U(Y(aY(o[(�](:l('r(&t(�t(?v(�v(�x(�y(7(�(��(֐(�(;�(:�()�(��(��(~�(��(0�((�(\�(��(�(:�(m�(��(21�(��(H�(�(�(��(?�(�(%�(��(�(��(��('�((*)31)*2)�3)!@)'B)5W)�X)�c)Ad)e)�{)m�)��)H�)��)ۛ)a�)�)��)��):�)��)A�)x�)��)��)�)�)��)��)M�)�)i�)��)��)f�)��)�)[�)#�)/�)��)��)��)��)L*�*A22*�23*h*�**** *�*�*u**�*�*k*�,*�.*�9*	@*�@*�B*�C*iD*xF*�K*.L*�L*�M*�M*�M*_N*�P*�R*�S*�U*V*xV*[*�[*bg*Nh*Mk*lk*�l*�m*�q*�r*�u*�v*z*0�*n�*�*��*��*��*+�*�*ݣ*ʤ*��*N�*��*��*3�*��*��*��*��*��*7�*5�*��*��*O�+��+B�+��+��+&�+
�+:�+|�+t�+a�+Ц+�+E�+N�+��+��+��+ï+�+d�+��+��+.�+��+S�+��+��+`
,�,�,},!,�!,�$,%,C2,�5,T6,�7,�8,u;,M<,>,�@,KB,YC,�E,2J,�J,�J,�N,�N,�W,[,�[,�],B^,�^,a,�b,$c,d,�i,�i,kj,'l,�m,�m,�o,�o,�p,&q,ur,�r,�s,u,9u,�v,w,#w,ly,�y,�y,z,�{,5�,�,z�,V�,��,�,��,��,c�,�,]�,X�,��, �,��,��,��,ؗ,v�,��,v�,�,��,�,e�,��,�,\�,ʬ,۵,��,;�,^�,��,R�,��,24�,��,��,#�,��,��,X�,�,��,m�,��,��,��,��,s�,��,%�,�:-?-�?-C-ZC-UH-8N-�Q-gS-XT-eX-Y-�[-2]-�]-Fd-�d-Rf--h-:k-�m-�n-tq-s-Bu-qv-Yz-�-*�-b�-��-y�-�-D�-�-G�-��-��-�-e�-��-��-4�-ܷ-��-�-�-��-v�-!�-�-m�-��-^�-��-3�-R�-�-��-a�-`�-��-��-L�-�.�
.�5.�:.�:.�:.;.�<.�>.n?.JA.�A.�B.�G.�J.�J.�L.N.^N.�N.
X.�X.rY.m^.�^.ja.�a.gc.2e.Ge.�e.>g.�j.o}.�}.~.�~.�.��.(�.R�.��.c�.ċ.�.\�.�.�.��.�.Y�.��.z�.4�.g�.��.��.�.��.ߦ.~�.�.N�.��.լ.�.�.m�.��.!�.��.�.t�.1�.l�.��.��.h�.��.��.e�.O�.��.g�.��.<�.��.��.E�.&�.��.��.�/�/�/�/�/	/=	/�	/�25/�/0
/u
/�/�/�/�/�///�&/O(/3/�4/M7/Z9/	:/q</�</zB/�B/�C/Hn/�n/2x/�x/�z/g~/y�/Ѓ/�/�/��/ɍ/.�/R�/��/��/̝/r�/�/��/�/��/��/��/��/E�/@�/��/�/�/1�/o�/E�/,�/`�/��/��/��/��/��/�/]�/&�/��/{�/��/	�/q0�%0�%0�'0�-0�00D1090�<0kB0lG0�G0DI0`J0cN0|O0�P0yR0[S0�S0T0W0AX0mX0\0^0v_0Va0ub0&c0�e0ij0�k0n0Xn0
o0Mv0�v0��0��0�0��0B�0�0��0K�0DZ0��0N�0�0L�0H�0�0U�0)�0h�0]�0��0�0�0Z�0o�0t�0��0��0��0�0j�0&�0��0R�0��0q�0��0��03�0��0��0N1�1�1�1�1	1!
1*1�1I1�1�11X1�#1;$1�$1�&1>*1�x1�y1B�1f�1��1��1̸1u�1ٻ1��1��1d�1��1�1H�1��1r�1��1�1x�1��1�1��1��1��1�22�22.262�2722�22H 2~ 2� 2>!2�!2�"2N#2L$2�&2�&2B*2�+2T.2�.2i22�422872�92;2H<2�=2�D2eE2�L2N2�N2cO2�t2�v2�x2�x28y2�{2L~22@�2ǀ2��2��2{�2�2d�2ё2��2/�2��2A�2ԗ20�2W�2��2r�2��2�2I�2:�2ӟ229�2��2��21�2{�2��2e�2'�2S�2��2ݸ2�2i�2�2(�2N�2�2��2��2��2+�2k�2��2��2�2��2��2{�2@�2h�2��2�3�3u3�363@3�33�3�3n'3�(3*)3�)3}633?3r?3�E3�M3�Z3�Z3�\3�]3�b3�c3@d3bk3�m3po3"q3]q3�q38�3f�3‹3�3��3m�3��3�3��3V�3��3�3�39�3X�34�3~�3��3��3��3��3��3T�3�3��3��3��3��3�/4�\4�^4Kc4	d4�f4Eg4�g4�h4*j4;s4Is4ws4�w4x4�}4�4+�4��4�4�4�4ڛ4N�4�4Ý4P�4�4��4%�4ȵ4̸4��4m�4�4#�4c�45�4T�4��4��4�4Z�46�4�4��4y�4��4�4��4��4�	5
5]5�5w5�55.5595�5!5j!5x!5"5Y#5,%5X15)55�55sG5�G5sH5W5�W5�Y5�[5\5@]5�a5�c50j5�x5y5�|5
5N�5��5��5��5x�5�5�5Y�5�5�5��56�5)�5c�5��5�5`�5[�5��5z�5m�5�5x�5��5��5W�5,�5�5y�5��5�5��5�5�5.�5,�5��5��5�5��5�5�52�5x�5��5��5��5��5��5��5��5P�5b6�	6�6�6�6>6
6�626B6!6"6$6�%6*6�+6x2646"46<6@=6��CD�C��CH�C��C"D�DfD�D�D\DD9D>DmD�D�DZ"D�%D^&D�+D/D:/Dv0D�0DM1D�1D�2D�4D�gDFhD�kD}oD�pD�uD�uD�vD�wDyD׀D��D�D2�Da�Dg�D��D^�Dl�D^�D�D'�Dt�DL�Dh�D�DN�D��D��D��D2�D��D��D30�D��D��DD�D��D&�D��D��DX�D��DN�D%�D*�D	�D��D��D��Dp�DWEjE�E�E31EE(E\EyE�
EEjE�EKE7E�E{EB E�!E�!EN$E�$E`&E�&E9+E.,E-E�-E�.E�;E�>E/@E\OEnQE�VE$WE�^E'`E,aE<cE�fE5gEomE6pEAtE�vE32zEezE�}E�E��E�Et�E&�E��E�E<�Ei�E��E�E|�E�E`�EƱEķE&�E��E��EW�E3�E.�E&�Eq�E��E{�E��E��E��E��EY�E��Ec�E�EU�El�E��E��E��E��EQ�E��E��EEF�F�F�	F�F%FlFtFFNF$FX%F�%F!-F�/F�1F�2F&9F�:F=F�CFEF�FF9JF�H[HH�	He33Hv34HEH�H%H