Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00106_00000_shuffled.ds.index86 linesDownload Raw Back to root
1�}�;^Z�
e�� !�&�&{'�)�+�,2./�/�;=�>@m@5AE�GDL�L�L�N1O�QTV�V�VMW�Y�Y�\�_R`�`ha�aEc�e;g!hk^k�l�m�m�oTp�qr}w�w�w?|�~@�e�̈́?���ӓ����•ߕL���"���<��>������[��������u���������;������������6�w���d�^�������4�o2
X>"�"�"
#N%�%(q*a]�dhOi�iejktk�l�p�qTu�u�v�8���0�����G�1������q�����%����>������y�C����u���	�$�(+)})*k.R/�/{2��{��`���C�����E��#1%r%�&�(8)�:�:�<�=�M6PMQ�Q�TO[�\�]�_=��B�_�?����ˇW���ȑt�I�v�t��9���������������O�E�����-���U�����!������������n�Y�U�~���g����N�S�����2c�6	<�c��gG���%�� �!\#G(�)u0�0T2�2d4J5�7[819�;*=*?\?|@�@�DRI�I;J�JJL�NtPU�U�X�Y
[_�anh_i�m�pnu����ډ2�S�9���6���$����Ɲ����U���\��ɰ;���6���w�$�������$���F�)���X�b������8�/���\�����3�!�����h�}�6���b�a�4-�� � �!�'�/�0@5�8u9):�:O?@YB�B�C�DaHI�JmL�NnSa[�[C^Fcd�n�nGs=u2w�w�x�y�z���a��F�����0���h�ٟ��i��±����r�i�ź8��������2���V�	�5�c�����5�>���?��Z�>��� �O������̣�����������������~�d���������������������F	�	e	f	�		6		�	�		#	�	�	k	�	�	�	m	�	�	 	!	�"	@#	v#	�#	�#	&	V)	,*	�+	E,	>1	O2	�2	�3	�5	n:	�>	a?	�@	J]	hb	e	�e	Wx	�|	�}	��	Շ	�	��	��	'�	G�	;�	�	J�	Ξ	O�	��	��	��	�	��	��	�	��	��	.�	p�	�	F�	��	A�	��	��	��	��	4�	��	��	�	L�	o�	��	,�	��	��	��	��	��	��	�	��	`7�8E9�10�11�412I613c614�6158816:17�A18`D19�D20�E21QG22�J23L24QL25O26P27)Q28iQ29�R30MT31�W32X33cY34Z35^g36�r37{s38�u39�z40}41��42>�43��44��45�46��4748�49c�506�51��52��53.�54��55��56V�57˓58�59��60�61Η62�63�64B�65�66F�67G�68Q�69]#U(n(�(&0�0R6m7�9C:o:�:�;�<B[�[(]�_[`w`�g�g�j8k�l�olp�vLjf����K�����ϐ-�O������W���[���̪'���ԯϰ����D��������������@�� �����N�i�b�J����D�WZ	���
q��)4<H���� O!h#@$q%H(�-�1�2�2{3�37�;�<�<@C`mWo�o^p�piqNr�r�s|u{J{�{y~����>���ގ���N�֨��ú޽Ҿ����1�&�d���T���5�H����x
�x
�y
~�
d�
�
��
��
Ʀ
f�
��
�
n�
H�
n�
��
L�
��
��
�
X�
t�
[�
O�
��
��
��
��
���|Y	^,
�.H��#!�!Q"�"�+0t0G1�1�>?�BD�E�F�HIyK�L�M�ST70U�V(XlXgZ�Z�]��A�����>�����������;���@�jTgEh�!�%�'�-�23(5p;[<�=B>�A�CK�L8O�[�\�^�b�f�f�gvh�lSok}=���Í5�f�V���2��������.�<�s�����������^�����A�|���������]�����i���L��7����6�����������:����& W!R"d&�,�,�-�0�1�2�Bu0&�0&�q&�u&ev&�y&�}&-�&ք&��&��(��(V�(X�(*�(��(��(��(��(y�(()�)�)�)�)�%)C&)�&)�')1()�+)F,)�/)�W)�W)�\)�])4^)_)�_)�a)�b)c)�i)�|)�)M�)�)͈).�)�)��)T�)�)��)�)Օ)ޕ)��)��)"�);�)��)��)��)�)`�)Թ)��)ƻ)ػ)$�),�)��)��)��)=�)�)�)��)��)p�)��)��)�)��)��)y�)Z�)�)��){�)�)��)�)�)��)3�)l�)
�)��)�)�)d�)��)"�)v�)A�)�*k*�*�*�*v*�*�*N**�,*-*�-*.*3.*\0*Z2*�2*�4*j7*�B*71C*kC*K*�K*TN*�N*�O*+P*%R*�R*S*6S*�S*@W*�Z*�*l�*��*��*Ú*$�*�*��*ڰ*72�*߳*<�*U�*��*��*��*�*��*��*3�*�*��*w�*��*��*�*�*��*N�*�*��*o�*��*�+c+�+�++C+�+�++�+�+	(+�(+�)+�)+,.+0+B0+6+�;+�=+�Z+O\+�\+�_+>b+�k+�l+o+}q+:x+�x+�y+ }+��+��+��+'�+��+�+�+��+ԕ+E�+��+c�+��+֙+[�+Ү+ׯ+��+(�+��+�+�+��+�+I�+��+W�+��+��+��+��+��+s�+��+Q�+��+�+%�+O�+��+A�+�,�,	,�
,�
,,w,,j,,�,?,g%,�%,�*,+,r+,1,n7,�8,@,�@,`A,xA,�B,lC,�C,+E,NF,�F,H,=K,�K,hL,�Y,�d,�e,�e,�e,�|,?},�},�},�,��,�,q�,�,7�,�,ښ,o�,�,Ĥ,�,X�,ެ,ݯ,�,q�,	�,j�,ϻ, �,p�,ڿ,��,��,O�,�,��,��,��,?�,��,=�,��,2�,��,��,��,��,��,^�,�,��,�,��,�-�-�-	-:-N--�-4--X-�-D-�-�-�-�-"$-�$-C%-�%-�&-(-�3-�9-�9-�?-
@-A-�A-yH->J-K-~R-�U-UX-Y-�Y-%\-�\-Ra-!e-�e-�f-Pg-%h-4i-j-k-�k-�k-;l-4m-�s-�s-+t-8v-Ew-�~-V-��-/�-��-%�-�-,�-ҋ-��-��-��-n�-��-X�-ҙ-��--�-;�-I�-Š-�-��-M�-��-G�-�-��-��-=�-��-3�-M�-��-��-C�-��-#�-��-��-�-d�-��-�-A�-��-'�-q�-��-�.H.�.w73.�.�.�.\.�.:.%.K1.22.3.�5.<.�H.�H.�H.�J.{K.AM.,Y.FZ.Fa.Va.b.�b.�c.d.�d.�e.�f.Qh.j.Sj.Ck.Mn.�n.o.jo.p.�p.r.Kw.�|.^}._~.@�.q�.��.Ĉ.H�.S�.��.��.:�.ѐ.��.ӑ.��.��.Ң.��.��.��.ճ.��.b�.��.ɿ.��.[�.��.v�.c�.J�.x�.��.��.<�.�.P�.��.��.F�.��.1�.$�._�.��.�/�/�/�M/pP/R/\T/�T/�T/FW/qY/�Y/Z/CZ/h[/]/2]/�]/�h/i/�i/Qj/�|/p~/:/�/��/G�/f�/S�/�/Ή/Z�/�/s�/��/X�/��/s�/P�/\�/��/ �/Y�/��/�/B�/��/�/|�/��/8�/Z�/	�/��/��/U�/�/U�/��/��/u�/�/��/��/g�/��/��/�00�0'0)0U!0�(0�@0tH0�J0L0TP0�W0j0ej0�j0wl0	m0�q0|r0�r0+s0_s0bw0�w0�x0gy0�|0$}0X�0��0��0�0�0ő0?�0"�0K�0��0��0ٯ0�0��0·0�0l�0P�0*�0��0�0��0o�0߿0��0��0'�0�0��0&�0��0&�0P�00�0��0/�0��0��0K�0�0��0�0��0��0j�0s1�11�11�1�1)
11r1�1�111g1n 1� 1%!1�!1�&1�)1�-1f31S71x@1C1�D17G1,H1GJ1UK1�[1�[1�[17\1�_1[a1�a1:d1�d1~e1un1+p1�s1\v13w1Dw1�w1x1�x1*y1�{1j~1�~1�1�1k�1�1��1�1_�1��1R�1N�1��1��1ޘ1H�1��1ϝ1�1Ş1X�1}�1��1B�1�1|�1��1��1K�1�1�1ӷ1��1O�1d�1��1�1��1��1��1t�1��1��1��1HB2-C2�G2�O2`P2JS2.U2�Y2�[2c`2@a2�q2�q2�r2Gt2wt2+u2sv2�w2p}2D2�2@�2��2i�2��2L�2r�2��2K�2u�2m�2��2�2��2H�2��2��2u�2X�2��2ަ2n�2ͨ2��2۱2��2�2x�2�2ۺ2ӻ2�2ټ2?�2�2��2!�2��2S�2��2(�28�2�22�2�2��22�2[�2h�2��2%�2O�2��28�2��29�2��2��2��2M�2	�2��2��2n�2+�2��2�2��2��2f3�3�363�3�	3Q743;3.3�3333x3�3*33�3\39"3($3�$3u%3�%3)3+3A.3�.3�13�:3W>3>3,@3eA3�A3�C30P3Q3�T3�U3ib3�d3�i32k3'z3�z3{3+�3�3+�3��3��3�3��3�3��3�37�3��3ʟ3�3Ǡ3��3�3��3ƪ3�3��3�34�3³3��3��3n�3��3!�3��3��3-�3;�3��3�3f�3�4�4(4O4�4�4�4�4�4�E42G4�G4�I4-K4�U4�U4XV4fV4YX4`4�`4c4Ec4�q4�s42v4�v4;w4�~454z4r�4��4]�4��4��4��4+�4N�4s�4s�4��4Ⱥ4
�4ν4��4)�4�4��4t�4��4��4��4a�5��5�5�5X�5�5�5i�5\�5�5ϸ5��5�5��59�5
�5��5<�54�5�5�5��5�5��5��5V�57�5��5��5��5��5��5	�5�5U�5��5�50�5u�55�5c�5��5c�5~�5��5��5��5��5��5�6�6�6�	6�6�
6n6�6�6�#6�)6�16536�36l66
:6�;6=6�=6>>6
?6#E6�F6�L6�L63N6�N6�S6�X6�\6�]6_6�_67`6�e6;y6�|6�~6K�6��6�6��6o�6o�6��6��6��6�C7	D7G7�H7 J7�K7�K7/L7�M7�S7�U7XV7�Y7�\7�^7%`7�f7�k7On7[o71t7v7ww7�x7�x7n�7ׂ7f�7z�7ׇ7��7��7ފ7T�7��7j�7`�7��7D�7y�7ٗ7[�7��7�7��7�7S�7�7��7I�7��7�7]�7k�7&�7�7 �7��7�7�7�7��7��7�7�7k�7I�7�7��7��7C�7b�7��7q�7q�7�7�7	�7��775�7n�776�7h�7k�7Q�7L8(8�8
8�
8�8778�8f8�8f8�U8OV8�Y8�v8�w8�w8Cx8�{8W�8H�8�8�8P�8��8��8�8��8�8�8U�8��8q�8;�8�8�8ʮ8�8��8R�8t�81�8h�8��8n9U9�9�99V9x	9{789�9�
99�99=9�9�99�9�K9T9iT9�T9�T9�T9�W9�c9�c9�e9Lg9	h9
i9^i9�q9x9By9V~9�~9P9{�9��9��9��9�9&�9r�9��9�9��9A�9t�9�9x�9b�9Q�9��9X�9�:�:6:�:X79:�80:r::\:� :x!:�#:�':}(:�(:�6:W7:�9:VA:H:K:Qc:d:�f:�l:5�:V�:��:��:��:Ӝ:j�:Ϥ:W�:��:�:��:�:x�:��:��:��:��:��:��:��:,�:��:u�:
�:��:�:1�:��:};�;�;
;5;�;�";\#;m(;�/;�0;d2;3;�3;"9;X:;e;;�;;|N;�P;S;�S;\Y;�[;|_;Nd;�d;�e;qf;�g;^i;�i;�j;am;n;o;�p;q;�q;�v;w;�y;{;�{;�|;a};w~;�;s�;@�;T�;��;��;�;6�;x�;O�;>�;��;ߟ;��;.�;��;��;�;m�;��;W�;�;a�;��;r�;�;��;��;k�;�;r�;s�;��;K�;d�;k�;<�<�<?<�<%<�/<W0<�0<�6<A7<78<=:<�:<�=<�?<a@<�@<aB<HF<-S<�`<a<a<b<�b<:c<e<�g<#v<�<0�< �<��<c�<�<U�<��<ޑ<E�<��<�<%�<�<)�<߬<�<��<��<��<��<	�<�<g�<<�<>�<��<��<��<��<��<+�<�<�<G�<��<S�<9�<��<�<r�<��<�<��<��<A�<��<p�<��<=�81=c%=h&=�'=�'=r*=�*=C-=d.=�4=s9=�9=�C=ND=�D=�J=�U=|W=�X=^Y=�_=pc=�d=�e=Xh=(i=j=�k=�m=
n=�n=�q=�~=.�=�=&�=��=��=-�=x�=Ŏ=3�=ؓ=��=��=�=�=��=Ϣ=��=`�=ޤ=��=E�=��=�=(�=��=��=`�=Q�=c�=��=�=��=U�=W�=�=@�=>>*> >U>�>�>�>>&�>!�>��>"�>��>��>��>G�>��>D�>O?�?;?u?�	?Q82?n??Db?�b?Bd?id?�e?�g?Li?�m?fp?�p?�q?r?�s?rv?,x?�y?z?�{?�}?(�?A�?_�?R�?��?&�?��?ٚ?l�?��?ѣ?0�?˥?��?5�?'�?ī?X�?��?j�?>�?�?��?��?�?+&@!,@?-@�1@LR@bS@fT@�T@�U@\@f]@w^@Y`@�x@�z@{@�{@l|@}@H�@�@�@��@��@��@��@J�@��@4�@��@�@�@Э@c�@i�@�@	�@�@��@H�@t�@��@_�@��@#�@��@��@��@F�@A�@�@��@c�@�@��@��@P�@z�@��@��@�@X�@%AUA�A�A�ALAAyA83�A�B!B�B�B�B�B3B�BhBB.B� B�$B�%B'B�'B(Bb)B�)B�*B,B�,B�/B�3B�:B�<B�@B�@B�@B�WB�WB�XB�XB�aB3fB�~BH�B��B��Bj�BӉB�BӓBZ�B��B��BШBl�B��BֺB0�B��B��B"�Bh�B��B��B��B��BL�B1�B0�B��B��B��B��BN�B=�B �B��B�C�84C�85C�C9C�
C&C�C�C�C�C)!C�!Ca(C�(C�)Cq*C�*C�,C�0C�2Cq4C�=Cd>C�?C�AC�BC�ECEFC#IC:ICcICDJC�JC�KC-LCMC.MC�PCnVCCWC0XC�[C\C^C�bCpCjpCrC�sC�C�Cw�C߅CŇCĈCp�C(�C��CB�C��C�CƠC��C�C�C��Cj�C�C�C+�CI�CS�CD�C��CV�C��Ck�CU�C��C`�C��C�C��C,�CO�C�C�DxD3D�DPD86D\D
D�D�DD�D,D�D�D�DD�&D�'D�(D�+Dq0D�0D2DH2D7DO7D8DN8D�:D�<D�=D�hD�hDiD,iD�pD�qD�tD�wDbyD�Dt�D�D�D߲D��D�D�D��D!�D��D?�D6�D�D��D��D��D<�D��D��D�D��D�D8�De�D��D[�Dh�D{�DBE�EcEIExEE�EBE�E�E3E�EE�EE+E�ELRE�UE_ZE�ZE]\E�\E3]E^]E�eE�gE�hE kE�kE�vE�xEyEiyEczE�zE{E�|E�}EwE�EO�E҂E��E6�E��E�E��E��E^�E��E٢E^�E��E��E[�E��E*�E>�E�EI�E��E��E��E��E��E"�Eh�E��Em�E��Et�E�E��Ek�E�E��E��E�EM�E)�E�E��EOF
FFOF5F�F=F�	F�F�F�FN&F�)F-F.Ff.F�.F00F�6F8FC<F>F@AF�eFfF�fF.hFiiF�lF�sF�tF�uF|F�}F�~F"FjF��F��Fh�F��FűF��Ff�FB�F!�F��FC�F޾F��F�F]�F�F��F��FE�F��F�F��F�F��F�F��F�F6�F��F�G4G�G{G�G�G�G�(G�+G�,G_.G�6GE=Gq>G�>G-BGYBG�BG>CGLDG�EGpJG�SG~UG\WGZG�kG�mG�tGfuG]vG�{G��G��GےG7�Gh�G��G�GȷG߹G�Go�G��G��G�G��G��G`�G{�G��G��G��G�GI�G��Gl�G��G9�G�G��G��G+�G��G�G