Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00000_00000_shuffled.ds.index28 linesDownload Raw Back to root
1�&m������	�	o2���� X!�#=$�%�)&*�-u.5�6J9�:�;�< =0=B>�?�?G�G�H�I�V�hDi�j�jelnm6w�w�����O���������1�^������O�i���]�}���	�b���"����������2���u!��	����PL�*!�"%u%&�&'&)k)+�+
:FC�C]DF8���<����8>�>�C�C?F�F�H�u'v?vmv�v�{|Z}3�J�L�C��w���=�l�����L���U�:h�h4jn�� �����q�����G��� �&���@���1�
�
H�
_�
��
��
��
0�
��
��
��
|��	�6[�"�"�$�$�&W6�6�6�;�=�@�G]�^�`vc3l�l���?e3�4�:#^+�-// 7�7f<�<3�������������ڕ�v����i���Šx���ڦ�������'�L�^�Q���D��������.�����z�����{�����i�t���n�r����.�S�p		Mx
O�~M���Q�������N"�":#${&�&u'�'�).8�8�;y@EC�R�gZj!k�l_m�su(uBu�y���'���ɑ������8�m������8�}����j�����q�ſ�������
���������L�G���v�%A���8(5�6>H�DyuR	V<Xk�Ό^��������r���`�����\���p�|��W�����������8���g�۷��������������o���Y�I�f���[���%���� &�)�l7X
�
��M��� �!}%�%�%u&�Y�\]�`�aQb)dZe�eOg�tqv�wy�yl{�{e���w��B���*�{��w����� ����������[�����_�C���������p�:���H�������[���w�	��6����^�I��!�%8'}(?)?*#+�-�8�8�9�:�:!<�?#K'L�XQZ�[\�\;m�y�z�}��5�܉'���u�Q��9���{�N�j�D�����������E������J�������
c �zb�ztd$�$�+`.�2�5�5:7�:I;};<�>�@�AB�IRJ�J�K�Q>R�R�R�S{T�Y�Zt]�_b`�a�a0g;g�g�jVl�no�o"v�|�F����������\������������C���0���m�����U�~���w�3��?!i!$r$<'!))&*�-p.u0�4�9?:�:;�=�>
@ED9F�HI5TTT8UyW9X/ZxZ�Z.`me�g�h�i`j+o�oNp�pBq�r4t�t^vǀ:�q��8�Ɍ&���N���:���m���O�����d�w���	���%�����_�����������4������l���B�Vo/G<��f�+@�R!�&x'�(�)�+�,�-�.T1�1&6�68>�>f?�?�?�A�C�F�I�K�R�V�X�Zo[-bpb9chl/l�l�l�lxp�p�pt�y�|�}N���9�����9���m�������Z��j�o�\�X��4����!�"O%�(A*2�2E6<�?@�B�H�Q�T{UW�W�^d�e�f*g�gh�h<i�iRm�q�s�t�u�v�w;{�{_}�~����N��������e���R�����9�_��������#�'E*f*f7�8�G�I�J�K�L�M3NmO�P�P@R_a�oyv�x�{K|&�k�p����(�������Q���;�ĩ}����J�����/�Ѷi�8���$����������������`���=�&Jcvy��!%�&10)�*�-�-eG�HK�K�M�R�g�h�i_m�n(o�svx�xy�}X#�����5��������������o����ܤ
������V������u�)���������L� �������H���	E11T12�13=>[��W�W!�!"$AFAF7I�I�J�R4S�S�[�`�a�b�eg�~׍=�3�ے٥H��h���G�߫����k������׻-�����x�V�������Z���m�������&�W5�57#;�;�;�=~?�AEQE�FGHN�N�Q
S�S�Y_agri�n1opф�����������H����ݪ�v���������ײdz:��q�ٺ��S�����K�������i�Z�m�[�������a����R��������2�w�y�<�ytv�v��?�B��\��������w�/�E��n����k�O�8�̦ǧ@����A��_�´��������h����� ������1�A�N�����������C�+���s�  G u  � � b . � � " � c" �" $ O2 A4 �4 �5 �8 '9 k9 �: D; �= �? *E �E �F $G .I �L 14O �P uQ �X �Z �] D^ l_ a 0a �b Ud �d �e �f g &g �g k �m �n �p q �r {� �� �� �� ؕ 15�)��)z�)��)B�)�)16�)��)8�)�)&�):�)R�)��)g�)�)��)��)��)��)`�)��)��)R�)S�)��)��)��)z�)�)��)�*�**�*y*�*?*4*"*�,*9-*.*�.*-/*�2*Q5*)K*:N*�Q*sS*��*ڮ*��*'�*z�*D�*��*�*e�*x�*��*��*�*}�*��*��*��*v�*��*f�*��*I�*��*��*Y�*��*��*��*)�*�*��*�+�+#+�+�+�+�+~+R+Q+b+e0+P1+W2+�2+#3+k7+O8+�?+�B+F+�J+,K+�K+eV+�V+�V+�W+MZ+[+o[+�[+T\+�g+�v+Vw+Nz+[|+߃+�+�+;�+v�+܋+�+ܓ+��+`�+��+֛+��+ޝ+��+��+�+��+X�+�+��+
�+H�+A�+o�+��+E�+c�+��+Ӯ+��+�+�+K�+5�+��+o�+b�+q�+'�+�+k�+!�+��+�+�+2�+��+��+Q�+~�+��+_�+M�+��+��+k,�,	,L,�,�,
,�
,],�,�,�F,oG,�P,W,YX,�Y,[,�[,�[,N\,�],�^,�_,m`,�a,�h,]j,z�,Ǘ,˘,/�,��,}�,��,ȟ,Q�,�,ɧ,9�,�,۴,U�,+�,��,�,`�,�,y�,%�,��,:�,��,o�,��,�,��,��,A�,��,��,0�,�,��,,�,��,�,��,��,��,�,m�,17�,~�,��,]�,��,�,r-�-U-2-6
-�
-.-�-�-�-�-:!-�$-�'-}--R/-n/-�2-�3-a4-5-�?-�N-�O-EP-]U-�b-j-�j-�q-�r-f|-}-��-�-J�-^�-�-�-��-�-�-��-�-��-<�-��-@�-��-��-s�-�-��-��-@�-!�-*�-��-M�-��-V�-��-��-��-�-o�-��-��-��-$.$.f.�.G^.�_.`.X`.�a.Pc.�d.wh.�i.�i.v.kw.�w.�w.�y.�z.;}.�}.�.ـ.\�.��.�.ɤ.�.��.��.�.6�.�.G�.��.��.M�.=�.��.�.^�.��.8�.��.F�.s�.��.��.Y�.�..�.��.�.��.O�.W�.��.�/K/�//H/�/
/�/�//�	/�/B/x
/d/c(/o(/R+/E0/1/2/5/;7/�@/�A/�A/�B/�S/�V/�Y/�Z/&\/�`/�`/*e/�e/
h/%i/�k/{l/!o/�o/4p/�p/x/�|/(}/Z�/|�/��/��/]�/#�/0�/t�/��/e�/:�/a�/ѓ/[�/C�/=�/ݯ/o�/��/�/E�/R�/ں/{�/��/5�/q�/�/k�/��/:�/Z�/��/��/>�/o�/{�/��/�0b0�0P0�0�0�0?0�0v0O0& 0:!06"0�#02$0�+0�/0�50�704c0Yh0�h0�h0ai0�z0�z03|0~�0��0q�0��0�0��0d�0{�05�0`�0ȕ0��0��0:�0��0�0|�0�0)�0̪0&�0E�0��0ŭ0ƹ0!�0�0��0��0#�0��0,�0�0@�0i�0��0��0��0��0V�0��0m�0�0(�0c�0��0��0�0#�0��0��0y�0M1k1t1w1�	11�1�1�1�1�11�1+1/1=11+ 1� 1t!1�#1n$1�$1�%1�&1�&1�+1;-1�-1�.1J11�1141�51-61�61>71�71�71�71�81�91A@1\B1C1{D1ZG1�I1)K1LM19N1<V1�V1�V1�V1�W1Y1�Y1NZ1�d1�e1f1Wh1�i1�j1,k1m1�m1o1�q1�s1�s1�{1|1�1*�1Ł1N�2V�2�2��2��2z�2l�2�3�3�33�3�3�	3�	3�	3C3�
3�3�393�3�3�3P(3S)3�)3�*3�+3w,3�,3=3�E3�O3�U3X3�Z3]3�]3�a3(g3�h3Sk3l3�m3�m3�s3�y3�z3i�3}�3܇3i�3/�3��3k�3��3�3��3}�3x�3��34�3!�3M�3P�3��3�3Y�3�3��3��3t�3c�3x�3��3u�3��3�3��3�3R�3r�3��3T�3��3��3��3(�3��3!�3��3��3A�3#�3��3��3Y�3��3��30�3*�3��3l�3��3+�3��3��3=�3��3�4�4Q4�	4-4�4s4�464
4<44E!4e!4$4U$4%4).4�.4j14<24�2444�94=4�>4�>4B4�B4C4|C4�I4FL4�N4$O4AS4�T4�V4�W4�W4�X4[4W`4�`4b4(b4
c4�d4��4P�4��4]�4�4:�4��4��4��4��4��4 �4k�4R�4��4Z�4�5�5Z5?!5�!5�!5�75t:59;5->5�>5�A5�E5�R5U5�U5�Z5�[5�\5-]5Y^5�^5�^5a5e5.f5�f5�h5�h5{m5Sn5�w5'x5�z5O{5�{5Ӄ5�5چ5p�5ʈ5��5w�5��5&�5ǖ5��5��5O�5��55�5ף5�5^�5Ƥ5��5.�5G�5��5��5�5��5S�5��5O�5N�5O�5J�5��56�5��5N�5��5��5�5\�5��5E�5��5��5G�5��5��5N�5��5��5��5O�56�5V�5��5$6#6�6�6�66�6�6]!6G"6m"6�#61%6�%60&6�'6B,6L-6.6�.6�/6t:6�;6�=6�A6�A6�B6*C60E6F6PG6H6�H6"I6�I6L6�L6eM6�M6N6�]6��6	�6F�6)�6��6��6�6:�6Z�6y�6E�6@�6#�6~�6A�6��6�6/�6k�6��6��6Ʃ6_�6��6.�6X�67�6�6U�6�6O�6��6�6�6��6��6?�6��6L�6��6[�6��6��6.�6��6��6��6��6��6��6�6z�6��6x7�7�&7K)7�+7�-7�[7�\7a]7_7zi79k7�k73l7'm7�m7o7�o7p7�p7�t7`u7�u7�u7�u7�v7az7e{7v|7�|7�|7.09�19C39�49/69]69{99s;9�=9�>9]?93A9B9TD9CE9�F9pN9.a9�b9.c9i93v9G~9�9��9:�9�9�9�9�9'
:A:�:�:�:�:g:�:Q:jM:TN:MP:S:hS:�U:]V:�W:SY:pZ:�Z:�[:�b:d:�o:�o:3p:Ft:�t:u:�u:Rw:Oy:�z:�:�:D�:g�:+�:��:݉:��:��:'�:O�:x�:�:��:=�:ӗ:[�:��:%�:Ӡ:"�:�:Ϧ:��:�:��:��:z�:��:޴:�:�:��:��:��:8�:��:��:��:�:��:i�;غ;��;��;��;Ͼ;X�;��;T�;��;��;�;��;��;u�;��;�;�;1<}8<�O<�Q< R<�S<�U<�X<�X<jY<Q^<�d<4h<yh<�h<[i<�i<�t<�w<�x<�x<1y<X}<�<��<18�<?�<r�<19�<s�<��<˕<�<7�<�<1�<�<�<ѧ<j�<�<O�<��<��<��<̮<�<��<��<
�<�<H�<2�<��<��<��<��<�<J�<2�<Z�<��<��<w�<��<��<h�<��<v�<��<��<Y�<S�<F�<��<�<I�<u�<�<�<X�<j�<��<-�<d�<��<�<��<Z=;=A==�=7=�
=�
=v=�==�=�=5\=�_=�`=Ia=	g=�g=5o=Io=p=�p=jq=�q=s=Dv=$�=S�=�=C�=��=��=-�=�=ש=��=��=��=��=ܲ=��=�=x�=��=Ƶ=�=�=�=�=��=�=��=M�=��=F�=|�=%�=�=Q�=��=��=��=�=��=M�=n�=;�=k�=��=��=S>�>�>�>z	>7>�>
>|>�>2>�>z!>�$>�'>�)>�2>3>D=>�@>�H>I>1K>KN>�N>P>�T>MV>�Y>_^>"_>0e>f>i>�i>Aj>5k>�k>Kl>m>20n>en>�n> o>�o>hr>s>7y>}>�>2�>��>�>��>��>S�>�>��>�>[�>h�>'�>4�>�>ܴ>Q�>?�>+�>S�>�>21�>?�>��>��>�>22�>q�>��>z�>��>}�>��>��>\�>��>��>e�>0�>��>$�>��>�>��>�>��>��>��>�?E	?
?�?f?�?*?�?�?�'?(?�)?9*?W+?�,?�.?�0?5?6?^6?�6?7?�;?�C?0Y?�Y?�Z?Q\?�]?e^?�a?e?1m?n?n?�n?Bo?o?��?<�?}�?��?��?��?̿?H�?k�?E�?��?��?(�?�?�?��?��?�?�?n�?_�?f�?��?��?!�?��?��?��?�?��?�@�@6@q@�@�@_@�@5@Q @�"@U#@�#@�&@�2@D4@55@w5@�5@7@[7@�8@>:@T>@�>@�?@-C@IC@�D@nG@mI@�I@oK@�P@�Q@�R@AT@�V@�X@�Y@�[@�\@T]@�]@u_@��@��@Υ@t�@��@ǩ@��@q�@��@H�@A�A�AcA$A�A-A�!Av#A�(A"+AU-AY/A�/AR3A�3A�yAt{A|A�|A�~A\�A��A3�A��A~�A��A؟A�A��A'�A%�AƤA�A@�A�A�A��A23�A��A��Ax�A��A��AU�A��A��A��A8�A��Ae�A��A�A5�A��A��A�A��AhB	B�	BO24B�25BqB@
B�*B�,B�/B>1B24B�4Bl7B�?B�?B/@B�@B�HB�IB�IBJB�JBjMBpRB�TB�UB�UBxZB�`B�aB�eB�kB8tBhtBEvB�vB)�BU�B>�B��BP�B5�BלB��BB�B��B��B��BĿBJ�B��B��B��B��B��Bv�Bl�B��B,�B��Bd�B��B.�B��B]�B�B��B��B��B��B26�B��B��B��B��B%�B/�B�BU�B�27C�28C�C�C�$CK%C�%Cp/C
3CZ5C8CS8C�:CF=C�=CN>CO@Cy@C�@C�BC�CCEEC�ECmFC�FCcGC�`CneC�fC�gC�hC)iC�iCjCUnC�nC�pC�{CU|C}C-�C}�CفC��C��C��C�CB�CO�C�C=�C�C.�C��C��C��C$�C��C��C��C��C2�C�D?D'DJD|D�DCDbD�"D�$DW&D�6Dl7D�;DP<D�<D�>D�>DxWDb[D�\D�]D8cDweDfD�kD�lD�nDHpD�zD}Dm}DCcEkE�kE*lE�lEoE^pE�pEkrEUsEctE�tE�tE�uE�vE;wE؉E^�EٍE"�EG�E��E:�E{�E0�EW�E��E+�E%�El�E��EX�E��En�E��E��E��Ey�E �E��EP�E��E��E<FAF�AF�CF�CF�DF�KF�LFmOF/SFZFm[F#]F�]F�^F`F�`F�`F aF.kF�kF�lF�lF�oF�FP�F��FY�Fz�Fp�FƒF�F!�F��F�FƆFk�FۉFa�F�FǘF��FL�FʡFO�F�Fj�Fc�F��F�Fz�F��Fe�F׮F��F}�F�F�Ff�F��F��F��FW�FJ�F