Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00046_00000_shuffled.ds.index30 linesDownload Raw Back to root
1�}���L�o��^(�)/*�/?0�0�1�1�2f3�3?cB�CD�D|J9KrL�MhN�N�O�P�P�RTsU�U�WV�߇n���������&���F�%�Z����������z��נ��.�>���ݥ2���(��a��j�J�'�f�����
��ݿ���������5���w������������;����������������H���j�r�.&2�3�4��+=��D���4 J$�&�(�(g1�5�<9=>�>*?A�\}k�k�m�n�o�q�q�r�st�w5xhx]z�zw}�~5W����ۇ@��͎k�6�R�Ɯ��)�����W���o����P�m���.�i�V�b���(�����`�����+�	����������	����1����"�%['ԅ7���U�X�����^���Ҩ>�<�Y���P�����9�����n�G���Y���P�����������������	#c����:���� ]"
'L)*d-�1$2�23�344�4�?�@B�B(gQk]l�tu�wGx$z�{�8�p�ń���Q�š�#�ƞ��}���r���Ѯ������R������X����l���?���+������Y�K������
�
o
c
�
K
`"
|*
�I
�T
�c
�e
f
5h
�i
�j
l
_n
�p
%r
Qr
�5����g�����q�y�o�
�����6���a�G��s�&�����������������e�&!-v5�7"8�8�9�:C<j<B`DJxPcd�df;g�g%k�ko�q]r�svwr�K�#���<�`���(���R�u��]��ʽ��������bU#&l&�(d)e253�3M5�@�D�DE�I@J?O�Y=Z�Z7`tcRj�j�kl6lir�s�v.z*~�~��*��������/������2�g��-�s���6�i�����ǝ����7�a�
���ҧ��~�U�0�������?�$�>���r���]��������7�%�f����?W�\8�9U����Q�T�V�VMWeX�b7c�fiTs:t�x�yvz������@�Q�b�ԉA��n���#���ߝ_�&�z�M�J����η��]�O�s�^�����a����������D�e&�(u57�7�8�:�;�;�=@�@�HMNZ_Z�ZI[�\_�oApCs�s)uo{�{"|�|��l��0�D�f�҅���݉���q�m�c�Ֆ؛������,�x�V��e����������1���������?�W����.���W�%�������w������������I,���%)�+�2�=>�A�BDM�N~Q�W�X\Z�[�]F�k�G�v�-����������x�ڜE��E��������L�3�]
�
&��#10I*IPJ�KWLVO<VuW�X}Y�[\�]J^�_�`AaTeLk�+���\�Ε��V�����{����B����.�[�������@�ۿ1���*�!���Y���D�������1�3�{���,�m���������	d
M��in�����_���������2������p�����3����g�%�����11�F
Y���`�M!�!�#�*�1�2�r�s�s12t�w-xrxuzV~�]�n���l�H��P�V���̦��Y���o�϶"�S��������~���!���
�G��`M�&.�"p*W+%N�O?P�P*ThNhj�j�vNx�x�x�x�y�|�~���g�����ѓk����ݘ�-����4��k����۲13����������G���?����g�q���#�q�Y�:�����<��w�������z��14`�
�,��fE�x�� (!�#�%�&'f)�+�A*M�Q�R*TET/UF[�[Cc�djij�l�w�yvz�����f�e�(�K���*���8�������"����(���U�O���>�l�(�]���2���>����&������e���>���$�&(�)�+�,b.�4�5�8�9w:<�<HB�D�G�JpLM�Y�Z�l+p�prSvowy�y{�~�~*���ԃ��5�[�������ߏ�(�	�n�%�E�8�K�����s�����)�D�W���L�������`�����-�����$�:�����X��X���	215�
��E![
M*�;16^�D��&C�&*�&y�&߇&)�&�&��&Ǐ&X�&��&#�&��&��&�&̝&ޠ&�&D�&=�&%�&��&ʴ&e�&B�&�&��&��&
�&j�&q�&_�&��&9�&}�&	�&U�&��&�&��&��&Q�&�S*+U*W*�X*�[*Z^*�^*,`*�`*�b*�b*gc*Rm*�m*Yp*�r*�s*Pt*�t*�t*�u*�*6�*��*O�*��*«*�*��*չ*!�*�*��*��*ο*��*�*v�*�*8�*	�*$�*t�*��*��*l�*:�*q�*��*1�*��*��*/�*�*>�*��*Q�*�*��* �*o�*��**�*��*�+�+�+�$+�%+�&+D2+a3+�7+�7+~@+kG+3H+EK+%R+�W+�X+OZ+%[+�\+z]+�^+?`+�`+�b+�b+Wq+�r+7s+ps+�s+8v+�y+�z+W{+Y|+�|+B+$�+�+݅+D�+&�+k�+��+�+0�+�+A�+{�+J�+��+Ӟ+	�+Z�+��+Ԧ+�+��+�+Ǭ+Y�+��+ڳ+4�+��+�+��+��+*�+Z�+:�+��+�+r�+��+�+��+��+��+��+��+��+�+��+��+��+��+�,�,,�,�	,^17,�18,,�,,2,�,,,,� ,� ,",p",�",E#,�$,G2,�8,:,�L,�L,pM,�M,EO,WX,�X,�X,�Y,Z,~[,5\,�d,hf,�f,�f,,g,jn,�n,ޘ,��,��,؜,k�,��,�,ͤ,�,+�,a�,]�,9�,o�,s�,��,��,��,'�,
�,w�,��,��,��, �,��,��,y�,��,��,�,��,��,#�,e�,��,��,--�-�-#-�-1-�-�--�-b-	-"-#-�%-�&-�'-})-�)-g,-�,-�--~.-�.-�/-�6-�6-V:-�g-�h-19m-�o-�p-y-�z-�|-~-�-ʂ-��-�-ϊ-e�-I�-^�-\�-ޖ-�-��-r�-)�-��-��-V�-��-p.x.M.o..�.n.�	.�20.�.�.G
.�
...[.C.�.�.� .�&.�(.�).,.�0.z1.K2.<G.�G.)Z.WZ.l^.�^.Jf.h.�j.�l.>m.�o.p.�r.�r.-s.�s.v.wv.�y.�z.�{.\}.�}.�}.n�.��.��.;�.�.Z�.�.L�.��.ˡ.�.�.�.e�.v�.�.A�.��.z�.��.��.O�.��.��.n�.��.��.��.��.�.��.��.�.:/�/&/�//T/'/�	/�	/�/�/U!/�!/�"/Z#/c$/.%/f*/�*/w+/�+/FI/�J/\K/�P/�Q/�U/�V/�V/W/�\/�\/5]/�^/�r/�r/Zt/(w/x/-x/q{/�|/��/�/8�/τ/b�/(�/��/�/ˍ/^�/��/�/��/,�/�/�/U�/(�/f�/~�/,�/��/��/I�/��/�/7�/`�/��/C�/�/�/��/��/L�/�/��/�0�0#0�0�00h0A0�0% 0"0$0%+0�+0�,0�.0Z/0!1080[90[:0K<09\0n\0�`0-p0v0�v0"x0Px0C|0~0Ȃ0��0�0Dž0��0$�0C�0�0�0��0
�0?�0��0ל0�0d�0��0�0��0U�0��0�0z�0ձ0��0��0��0*�0 �0��0d�0�0��0�0��0��0�0h�0��0]�0��0��0�0��0��0(�0O�0��0��0
�0
�0��0B�061�:1';1y;1�C1
E1}H1�H1�I1�K1�T1&U1�V1�W1mX1Z1#Z1bZ1�Z1�[1�[1�\1�`1�a1�a1�b1f#47$4,&4*49+4�+4s24�24�44�64�:4�<4�O4�Q4�U4�Y4E6rK6�K6�N6�O6yP6�R6DT6�V6�k6�k61l6m6�n6�p6B6��6��6/�6Ł6��6:�6��6=�6��6E�6_�6��6(�6��6�6/�6B�6��621�6f�69�6�6]�6��6~�6�6��6��6x7�707;7�	7z7�7177 7�7�77L7�7P7�7b7�7�7�7&$7V'7�'7(7�)7W+7�+7�,7�,7�.7�.7�.7d�7B�7L�7e�7��7��7��7��7��7/�7�7��7��7��7��7�8D8�8� 8�!8-"8�"8/#8T,8�.8(/8w/8�/8o18N38;48�58�68688�88�=8->8B>8A?8�?8�@8�A8hF8�F8�F8SI8vJ8�K8�W8�Y89Z8�Z8@[8[[8�f8\g8�g8�h8�i8�o8:p8u8�u8{{8�{8�}8��8�8��8��8��8 �8��8V�8h�8��8ɞ8��8]�8d�8ߣ8�8ƨ8��8�81�8��8��8~�8j�8��8��8"�8x�8��8B�8v�8+9�9�	9229P9E9�9�9�9�9�$9&9�,9�-929139�39�49�59xR9�T9�U9TV9P[9ze9�e9�g9Xm9,q9>q9�q9�t9Ix9�y9f{9�{9�{9�9H�9N�9��9Ί9i�9��9��9��9n�9��9��9�9P�9��9��99�9G�9#�9��9�9:�923�9[�9��9U�9-�9��9�:w:&:�:R24:�
:^:�:;:�:w:R:�:�:":{#:�$:T(:P*:�+:$-:�/:[1:�1:rU:�U:%W:�W:.e:�f:�h:�h:2:�:��:��:?�:�:q�:��:�:�:�:��:��:�:`�:��:��:^�:k�:��:��:�:��:��:/�:U�:S�:��:��:x�:{�:��:.;�;f;W;6;	;;;;G;�;�$;s,;_0;&3;�3;�5;�5;�6;�7;�8;=;�>;>?;v@;�J;TK;�K;vW;�W;RY;b\;�];6d;1z;�{;�~;;e�;��;S�;��;��;��;��;k�;�;�;
�;ŷ;�;��;��;L�;�;V�;#�;��;��;4�;#�;�;��;Y�;��;��;\�;<�;��; �;��;��;��;B�;+�;�;d�;�;��;��;C�;A�;2<<<Z<�<P<�<�<#<)$<Mg<*i<�j<�k<�l<o<�o<2q<mq<�q<�s<�t<�z<B{</�<�<x�<��<�<?�<��<G�<R�<��<
�<��<�<��<��<��<��<��<�<�<��<��<<�<y�<��<��<�=*=�=�='=�=�#=L$=�'=)=�;=�<=�<=�==�?=�?=�@=�@=hA=�G=�G=�K=4O=�Q=�S=U=�>�>�>l!>w">25#>e#>d$>�'>y(>b)>�)>l,>>->�.>�2>s4>�5>;6>�6>H7>X;>�;>�@>�A>TB>�B>�E>�J>�K>�N>�O>�O>�P>(Q>CY>�Y>Z>�[>K\>�\>�^>�_>�a>�h>qi>�n>�o>�v>{w>�y>Lz>�}>=�>Z�>-�>��>؉>�>|�>�>!�>£>Z�>�>�>�>��>M�>�>��>��>P�>ǻ>{�>��>@�>��>��>��>�>H�>d�>v�>M�>��>��>��>��>}?�}?V�?^�?��?�?6�?��?Г?��?��?�?�?��?0�?��?z�?��?��?9�?��?L�?â?r�?�?��?��?��?!�?��?
�?��?3�?�?i�?�?H�?��?��?��?o�?�@$@�@:@�@�@Z@-@�@�@�@b$@�$@�%@P(@�*@�+@%-@3@@3@�3@24@j6@26:@8:@]:@�;@~@@gA@\K@�L@9N@Mm@�m@�r@t@du@@~@�@��@�@Ŋ@y�@�@Q�@�@T�@�@��@X�@��@d�@ɶ@��@��@��@w�@+�@��@��@v�@��@n�@��@��@3�@��@��@�@�A�A�A�A$	A�	A�
A�
A'ARAAWA�A;A�A�]A�_A�`A�aA-bAMdA�dA�gA�hA�iA"sA\uA�uA�yA)}A�~A��A��A�A	�A7�Af�A��C �C��C��C:�C��C��C��C��Ch�C��Ci�C��C��C�CL�C��C��C�Co�C1D?D�DDED�D�D�D2DD�D�5D8D?D�@D�GD:HD�HD�HD�LD�MD$OD�OD�PD_RD�TDcVDiWD�ZD�ZD_D�cD�eDhD�iD�kD�lDmD�oD�oD�pD�qD�qD��D��D��D>�D��DA�D��D��D�D�DJ�D��D�D�D^�D��Di�Dj�D��D�E�E�E�E�E�ECE�E1E! E#E(%E�(E�(Ec)E�+E�1E��E27�E��E�E�EմE(�Ed�E�E
�E��E��E��E��E��Ef�E��E��E��E`�E��E��E�TF�TFUF�]F�^F�^F�_FbFrFltFAuF)vFY{FO~F5�F��F�F��F�F��FC�FV�F��F��FɥF��F��F�F��F��F��F_�F��F��F��F��F��FR�F��F
�Fo�F�F��FL�F$�FZ�F*�F��F��Fc�F|�F��F��F�GG-GQ'G�)G�1G�7G9Gc:G�:G�:G�>GhBG�BG�CG�CG�DG�EG�GG�HG�JG0KG*NG�PG�RG�TGYG\YGt[G�\G�\G^GMbG1cG�hG�hG3iG�pG^rG�tGXuG5G{�G;�G�GM�G�G!�GМGˤG��G�G>�G��G{�G��G\�G7�G_�G��G��G��G^�G3�G~�G��Gr�G_�G�G��G5�Ge�G��G�HHH;H�H�	HZ H�!H="H#H]#H�$Hh%H�%H�&Ho'H9+H�;H�<H�QH�SH�SH�TH*UH{VH2WH�WH�WH�XHv[H]_H�_H�_H``H�`H$bH�dH�kHsH	tH�tH9uHiyHK{H�|H.}H�~HqHހH�H�H)�Hy�He�H"�HU�H��H��H��H��HיH��H5�H��H9�H��H��H_�H��H�H8�H��H��Hh�H��H<�H|�HĻH��HԼH�H��Hx�Hw�H��H`�H��H��H�H��H��H��H��H�I�I�28I�IE#I�%I�'I�(I$*IT-I�>I{AIaBI�DI-iI^zII29�IF�I��I+�I\�I��I��I�IȊIËI��ID�I��I��Im�I՗IQ�I��I%�I��I��Ix�I��I��I�Ih�I0�I��IS�I��I�Ii�I��I��I��I��I6�I��I�I\�I�J9JYJJOJzJ�J�#J$J&$J�3J�4J5J307J�:J�;J<JSPJSJTJlUJ|WJ�WJYJ�\J ^Jt_JNbJ|bJ�bJ<fJpfJ>mJ�xJ�~J��J(�J��J"�J�JI�J�J��JٙJ��J��J�J�J�J}�J<�J�J�Ju�J��J�Ju�J:�J��J:�J��J��J�J��J2�J�Jt�J��J�J*�J$�J��J^�J��J�!K."K�%KJ'K�+Kt0K�0K�0K�3K$4K�7K�;K�=K�BKUDK~KK�VK�VK�WKPXK�XKYK�YK[ZK�ZK�[K�^K�cKdKeeK8wK�wK!�K;�KW�K��K��Kt�K�KM�K��K@�K�Kb�K��K|�Ky�K��K��K!�K��K9�K��K	�K��K?�K��K$LL�L#LILL�LLiL�LL LJ(L�(L�)L(*L�+L�,L-L.L�/L	3L9L\<L
?L>?L8LL�OL�OL�PLTL0VL@VLYVL�VL�VLlWLXL2YLiZL�ZL�]L�^L�_L<`Lh`LZaL\jL|xL}|L�|L�L�L2�L�LʌL)�LP�LX�LC�L��LƨL�L߭LԱLɲLc�LU�L��LʺLy�L-�L{�L��L��LW�L��L��Lv�Ld�L��L�LY�LN�L��L��L!�L��Lu�L��L��LI�L�	MDMxMg
M1MM�MMMLM�"M�$M�%Mv'M)(M)+M-MP.M�1M]3M5M8M�:MZ;Md=M+wM�M��M	�M�M]�M��M��M]�M��M��MB�MU�M��M-�Mt�M��M�M͐M��M��M.�M�M��MޟM��MP�M��M�M�M"�MT�M��M��M�M�M<�M��M��M"�M��MP�M��M��M