Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00087_00000_shuffled.ds.index33 linesDownload Raw Back to root
1^�g	+;��g"a#�#2'�/2�2E4�9;:\;7=�G.Q*R�W�XYWZ3\h]�]�]�_hc�h�iQkPl^l�m�o�s�wmx[ysy�z�z��|��0�1�\�ȩ!�<�f�4��@�	�:���;�����x���������s���"�����K���5�1�~�H���_���P�s�������������X�J�~����4�2 9+��K�����|� !$`$#%G%N:�=*>Q���L������T	m
�<+2�Am% �!2"�"�#I&))�H�IK�KIL�QYn�pWs�u.w�w�{�|�|�}��o�#�O�z�S����J�ی3�W�8�Ȑ3�ƑБ��R�v�4����ٗ�� �3������<���|�Ӧc�̧T���ڮ,�i� ����M�������9�i�?������C�����	�
Sp�(=X�Y4Z]gf�f�hql�l�njo�o�r^s�t�w�w{}"���b���v�^�}��X������У%�\�ǥ���§Y���
����_�p�q�����9���������c�����?�"�������w����8����2��������������'��s�	q�.-�1�1|2&5�7T8�8�8�9<>�?%BcO�T:U�Y�[\Kd�d�e�k�p�r�r�tHu�u�w��$���<�ъȍ��>��F�g���ן#�עt��ͧ'��ܬ������O�����@�-P3Q5�5�7/8:�<�Ų߲�x�H���������:�f������A���L�s���������P����q��1z�z�~�@������m���7�W���,�v�f��%���������w���i�¶Ʒ�����������?�U��o5!�
�!hX��E�E�P�PKQRQR�q�r,sattt�t�t�xby���F�*���������ө3�̭S�'�Ը?�	�#���������\�L�����J�����[���������>�������R������-�I���I��?67W�
}A4�	�+�,x-�/�1�2'3i386�60AB�C�D�E*F@F�G�H�]8_\_B`�a^f�fghi�{K~�~��d�K����o���m������}�.�U�V���i�w����������:�Q�]���o�����$�]'�'�)05[5�6c8$<<<(H�H_T�T�U�W�X�[�a�b�c�d=jpj<k�l�tw�w�xxz�Y�݁!�Z�����r�����/�Ӝ�3��2�^��N������E�5�Z���������2
@�CZ�u�":#�$�%�'�)�7�HsQ�RbS'T�fXi�i~j/sas�|�k�>���&�J���^�=��a�#��f������i������(���H�`�L���Z�q��K���������F�����\�C�����8SF�I�J�JYKNIOiP�PY[�[�\����l8�9�10�11
��
������9�"_$k0>3�3�:>yHIpI2J�X�Y\Z�Zy[o`�`,a7eze�f�p�q�qSt�u:�ہ>�Č�Y�ڏ��ޒ��d��*�I���9��
�K���6������G�ۮ�d]w]`�b&f�g�j֛МP����M����D���d��2�r�$����������������������kz"�&�(�*�+�,C.�4U5<N<=�=�?�?�F�F�H�K%N�O�O�TLU�U�V�XY�Z�Z�]�]Sa!de"fh�h:v!���ʗ������S��n�c��~���������� ���/�����/ 0 K0 #1 �4 �C �D �D IJ �J N TO �P +^ 12_ �_ �c ad �d �e �f �i Sk m Am �n �� �� � Ĵ � �� V� � a� � �� � �� �� s� �� � �� e� �� 2� �� �� !6!�!y!a!�!_!�!-!�!@
!�!]!�!�!�!�!F!�!R!�!� !�(!�)!�,!S-!N1!�2!�3!GA!�A!�B!�G!�J!�L!/O!�^!�^!1_!�_!8f!�f!�f!rg!h!�k!�m!n!$�!��!��!��!��!�!��!��![�!��!�! �!�!�!��!2�!f�!U�#|�#�#C�#W�#B�#
�##�#Q�#ݡ#,�#�#I�#5�#�#��#�#�#��#F�#��#��#=�#��#U�#x�#��#��#d�#��#*�#!�#��#`�#�$2$�$	$�	$713$�14$�$�$$b$�$/$�$/"$�"$}#$O%$�-$L/$�0$�0$n2$34$\5$�5$o6$J:$�;$%=$�=$�@$�A$�G$)I$�I$J$�^$)_$(c$�e$�k$�k$8l$ml$�l$�m$�m$�m$�n$�n$�p$#q$Ks$v$dv$�v$w$Cw$|$�$h�$��$��$Ɓ$��$g�$��$�$�)+�-+5.+g/+�/+q0+3+�7+�7+;+�;+�A+�C+6E+iF+MI+CN+sN+O+�T+�V+4X+aZ+�Z+[+�]+r^+#_+`b+�c+kj+�j+��+��+�+S�+��+��+1�+L�+n�+�+��+��+2�+t�+��+��+f�+��+2�+@�+��+	�+��+��+c�+�,15,16,�,	,S
,,f,n,�,j,A(,"*,C4,M5,�5,�6,`9,p;,=,�>,�?,�A,�B,�C,�C,�D,mR,S,�T,Z,�Z,�_,�a,s�,��,��,^�,��,�,�,�,��,l�,��,ŕ,�,��,ǖ,�,:�,��,[�,��,p�,-�,��,��,Ѯ,��,�,�,�,˼,i�,��,��,
�,��,��,1�,��,2�,B�,��,��,�,p�,��,S�,4�,��,��,17G-G-5H-xH-�H-�J-$M-\N-�N-�[-\-T]-�^-Y`-aa-Sc-zd-�d-f-�f-�i-!k-l-�l-�m-Cq-s-et-u-�}-��-Ջ-B�-��-��-�-��-��-��-��-r�-��-+�-��-Z�-��-<�-��-g�-X�-��-=�-��-v�-��-b�-��-��-~�-��-��-�-��-��-*�-��-�-|�-��-�-��-��-��-_�-�.....�.�.�.S.�.6.�.�.7.t .!.�'.�(.18..�..�/.�2.63.x4.�F.�F.eJ.�J.K.jM.9N.�N.$�.H�.��.�.��.�.�.�.�.�.��.��.��.
�.��.m�.��._�.��.��.�.��./�//�//E/�/�/4/�//�/A/&/0/�1/i2/�2/ 3/�6/JD/DF/
�2�2C�2��2��2Ϸ2*�2�2��2�2+�2T�2��2��2"�2z�2��2^�2��2��2*�2��2��2��2��2w�2��2��2I�2��2=�2��2�23I3#3l3)3�3,193
3�
3�3�3�'3$(3 *3+3.32/3�03�^3R_38i3_i3l3�l3xm3#o3�q3�{34~3%�3!�3�3�3��3��3�3R�3,�3	�3^�3˦3�3��3ͯ3_�3��3O�3��3��3<�3��3 �3��31�3g�3y�3��3s�3t�3��39�3��3W4 4�4�4�4�4�
4.4h4	44+4�4�4:4�4�4 4( 4�#4�'4�(4�)4>*4�*4+4Y+4�14�14TD4O4=O4�O4Y4�[4�_4�`4�y4!z4u{4�{4�|4�4*�4:�4�42�4�4�4��4��4�4J�4>�4
�4��4>�4�4ǡ4��4��4��4Z�4��4�4�4D�4K�4n�4��4ĺ4��4��4��4��4��4r�4��4��4H�4��4��4��4��4j�4*�4#�4��4��44�4�4n�4�4=�4�4.�4��4��4L5�505�5l5�5�555�5y5�545~65�75=5�=5H?5�?5�?5<A5�A5�A5C5WG5�G5�H5�H50I5�I5�I53K5sL5JP5[Q5�Q5�T5s]5�_5�`5Ya5�6�6E66U6�6�6�6B6�6=6�6�6U6�6: 6	"6�$6-%61*6�*6�*6�+6tL6nQ6�S6�S6�T6[6�a6'c6dd6�d6e6�h6i6k6r6�s6}6�}6`~6�6x�6v�6��6]�6��6:�6H�6��6r�6%�6�6��6w�6�6*�68�6c�6ǥ6�6��6��6^�6ۯ6ֱ6��6G�6�6!�6:�6@�6��6��6��6��67�6#�6��69�6�6R�6�6a7�7�7U7�"7$7'$7�'76)7*7�77�<7�?7A7�A7�D7oG7�G7)H7�I7lK7�K7�R7�W7�W71X7]7�_7\�7��74�7��7��7$8^Q8�Q83V8�V8�V8�V8W8[8^8�^8\_8I`8a8�b8�g8�m8�o8<p8�p87q8yq8�q8�u8�w8��8�8v�8қ8��8��8��8%�8ѥ8��8Ӱ8T�8��8�8Y�8��8�8|�8��8��8��8v�8��8�8j�8��8��8i�8��8�8��8��8^�8��8��8�9�9�9�9209[9d9�9�999f19h:9y;9<9�<9]@9A9�C9\F9�I9�K9�R9�]94h9{h90i9�i9kj9l97l9�l9�n9uo9Pu9�v9$w9�w9_y9�|9�}9@�9��9�9��9��9�9n�9�9j�9��9ת9B�9��9��9?�9��:K�:��:�:0�:��:T�:��:p;x;�;�
;�;3;�8;�9;<;�<;k>;�>;?;�?;�E;\F;�K;�R;"T;�X;Y;�];d_;�`;�`;8a;�a;�;t�;۔;3�;7�;��;#�;5�;̾;��;��;��;��;a�;��;��;��;��;o�;;�;i�;t�;��;��;��;��;�;~�;)�;K�;u�;��;�;��;��;21�;b�;y�;��;��;0�;o�;�<<�<i<,<�<<�<�<-<b<�<#<�#<�#<N%<�%<I<@I<hP<$U<�\<�\<y^<�_<P`<Xe<+f<Xg<�n<�s<�s<\t<u<<u<�<��<��<��<Z�<�<2�<h�<��<f�<D�<��<��<��<�<��<Y�<F�<��<��<�<��<6�<-�<��<L�<,�<j�<��<�=h=M=H22=�23=]&=�'=�)=�)=�2=�3=7=�7=9=�A=�A=�B=vE=�E=�F=Dj=�j=�l=7z=~z=�z=�{=�|=�=�=N�=��=O�=~�=�=��=��=�=�=��=+�=b�=D�=��=å=֧=ͨ=��=ǩ=�=Q�=˫=V�=��=̮=ݮ=F�=`�=��=Ҿ=r�=B�=��=��=�=A�=��=o�=��=�=R�=~�=`�=��=)�=��=H�=��=E�=�>�9>�l>
m>�>�>5�>��>��>{�>��>�>24�>V�>B�>��>��>��>�>��>��>��>�>d�>d�>��>j�>-�>��>��>%�>p�>��>��>,�>@?�?:?*?�?f?�?�?�?�25??�
?,?�?�?�?�?�?�?�%?a&?�(?�(?y3?�3?+7?OY?{Z?�\?26]?^?`?/e?�f?�f?bg?rg?^h?yh?�h?�l?�n?z?`z?A{?�{?��?N�?��?��?�?��?��?ŗ?�?�?��?�?3�?\�?;�?Z�?L�?l�?��?�?27�?��?�?�?��?�?�?��?�?#�?{�?�?��?�?��?�?�?��?A�?��?0�?��?4�?�?��?{�?��?��?��?��?�?��?��?�?P�?��?��?��?q�?�@0@�@�@Z@�8@�9@h:@�;@`=@�=@~C@vD@�D@	F@�F@G@�P@sS@�S@*W@�W@�]@�d@�d@6f@�g@�o@bt@�u@I{@�|@�}@%@&�@B�@��@
�@>�@��@�AA�A�A�AQA� A&!A�%A�%A�&A�&A�)A&+A�,Ap-AC.A�.AE1A,2A3A4A�5A�6A,8A<A�?ANAAFBAdCAHHAXIA<JA�NA�NAfRA�SATAYAUZA�ZA�ZA1[A�]A�_AbA�bA�bAdA�dA�dAHeA�fA�gA�gA�hAjAQxA�xA2�A6�A�A�A,�A�AŐA�A>�AϑA��A̓Aw�A��A��A��AΙA��A�A]�A��A��A�AA�AK�A��A��A�A-�A7�A��A��A��A��AA�A3�A��A��A]�A��A_�A�A��A��A��A9�ABB B�B@B4B�
B}B�BB|BUB�B> B~!B%BN%B*BS*B�+B�+BL,B�4B�8B�9B�;B AB�ABnCB�DB�EB�GB�TB4UB�UB�XB�[B�]BbB�cB@fB�gB�hB4{B�{B��B8�BB�BфB�Bc�B�BˋBq�B��BD�B\�B�B��Bm�Bj�B�B�BB�B9�B$�B�B�B$�BóB��B��BN�B��BǻBh�Bs�B��BпB��B��B�B��Bb�B/�B��B��B�B��Bw�B�B��B��B��B�B��B5�Be�B��B��BI�B=�B��BB�B��B��B�CD C2C`2C3C&;Cs;C[?C�@CEECFC�FC�GCXCZC�]C�^Ck_C�C��C��CςC��CЅC	�C�C�C�C��C6�CK�C��C��C�C�C��C��C��C'�C��C7�Cb�CA�C��C}cGdG�gG�gGhG�jG�xG]|G�|G6~GZ�GG�G��G�G��GV�G��G+�G��G�GH�G��G��G��G��G��GߧG�GݬG��GİG��G��G&�G/�G��G�GI�G��Ga�G��G��G��G6�G��G
�G��G��G=�G��Gk�G��GH�G>�G��G��G�GH�H-H�H�H�H�%H%3H�3H5H�9H/=H;>HoAH�BHyEH�FHnGH�qLArL�rL{tLuL�uL�vL)xL{L�}LyLQ�L�LC�L�LZ�L�L��LC�LҖLu�L#�L�L��L �L`�L��L�L��L�LߴL��L��L7�L��LR�L�L��L��L[�L��L�L��L2�L�LB�L��L��L �L��L��L��Lk�L	�L��L��L��L:�L�LY�L�M�M.M�MUMB MR$MO,M�0M3MB8M7:Mo:M_;M�;M�<M�=Ml>M�@M*AM�BM�CM�CMEM�EM�HM9IM�PM7RM�UM*_MJfM�fMgM�gM�jMkM�pM�qMYsMy~M�M�M.�M-�M��M��Mw�M��M��M��M��MO�M��M��M��Ma�M��M��M��MN�MP�M��M4�M��M�N�
NN�N�N�N�N� N�"N"$N3$N|%N�%N�'N�(NC*N�*N|-N284N�4N�5N�oN�rNIsN�tN|uN�uN�yN�{NыNd�N.�NW�No�Nf�N��N��NϛN��N�N*�N@�N��N�N�N��N]�N�N)�NJ�N�Nw�N�O�JO�KOMO�NO\^OL_O�aObO<eO�eO.fOpfO�fO�hOjO�kO�lO�lOmOvmO�mO@pO�qO�Oj�O�O�O29�O�O��O=�O`�Ok�O�ON�O�O6�OS�O6�OݾO30�Of�O��O��O:�O*�OO�O%�O��O��Oi�O��O��O?�O��O��O��O��O��O��O��O��O3�OV�O��O �O_�O{�OI�O��O�PwPhP�P P�!Pn#P�&P�&P3<P_<PS=P�=P�AP2EP�EP�HP�IP�IP�JP�JP`P�bPeP5gPygP@jPlPYlP%nP7nPKnP3tP�P>�P��P�P�Pd�PC�P"�Pi�P9�P��PӗPΘPH�P#�P��P��P��P�P��P]�P�P��P˨P�PJ�P��P�P`�Py�PظP��P+�P��P��PH�P��Pc�P	�PG�P��P*�P��P�P��P��P��Pu�Pk�P��PVQoQ� Q#QO$Q&Q�+Q{.Q
/Q�/Q�7Q:Q�?Q�?Q�AQ�AQ[CQ�CQ�EQ�FQGQ�GQ�IQeNQ�QQRQ�SQ%TQ3�Q�Q‰Q:�Q��QR�Q��Q��Q��Q31�Q4�Q8�Q[�QD�Qz�Q��Qc�QШQ��Q��Q �Q�Q�Q`�Q��Q]�Q�QH�Q|�Q0�QF�Q��Q7�Q��Q��Q��Q��Q��Q�Q��Q@�QU�Q��QO�Q��Q��Q�Q�R�R�RD32R*R�*R�*R<+R�,R33/R�1Rv2R?JRbKR@MR�NR�_R�aRhR�hRjR�nR(�R׎R�R�Rk�R�R"�R�RܞR֟R��RޠR��Rr�RM�R��R[�R��R��R �R��R��R��R	�R��R/�RC�Ra�R�R��R��R�S�S�
S�S�S�S�S.S�SHS�S�S�S�SYS$ S�2S�3S�3Sx4S�7S�?S�ISnKS(LS3MS�MS�NS�OS<PS5RS�SS�TSXS5YSeYS�]S�cSfSLfS�gS�gS�mS�Sh�S��S��S��Sm�SݮS��S