Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00005_00000_shuffled.ds.index25 linesDownload Raw Back to root
1R�����:
M
�
Gu4tx��$S)�*�+�-'.�.wxtx~zB���ӆr������.���������-�F���1�m��������9�:����]���Z���,�=��������Z�������u��N����g���1d�2��-/Y0:�BC�CwG!K�KM�WX7Z�[ ]n^�d�e�iak(p�uV{��J���\�v�����"������c�
�i�������������/�9�Q�B���'�a���*���O�s�k���5
I$�$O:�:�:�<V=�?�@dK&Q�R`�`^a�a�a:d�evf�f�ij�l�m�oTp�p�p�pYq�q�x{}3�r������‹�����]��ߕ����؛H���i����U�Ӻ:���ǽz�������}����F��������X���������8����������L����"����KU	�	�	{
��A:�/�\9"h"�"�#�&�+�,�,�.�.U0�M#y|�|}}�^�C��B�������צ�����d�����o�L�|������������
�x  H �!f'�(�.�/F0�3}9�>�>�@�C+E4F�GH^KxO�U�\;]Ec�dnsn�o\~!�Ҁ�r��|��O���"�g�̐B��K�ɦ��˪o��ͯb�Z��M���j���D�J�S�
�����f������#���������[ /$#(8*5.�1�1�3�3�45�5�6LQS�S�T�VcXY[�[�\]C]�`$bc�d�e�l=m�t�y}"~��_�J�ŒQ�������ٔ���|���N�.�W��l�����ȺD�ɾ�L���`���O�3�S��� �������h�U�y���Y������B(	�	�6�7Z�&M�]�� "�'z23�7~8>9�;C
D�D�EgG HLJNN�b:csc�cJf�g8hHi�jKk�s^t�v�wTx�y z�z<{E|(}{����\���M�#,�#��#a�#^�#!�#��#��#�#��#6�#Ǽ#U�#��#d�#u�#�#	�#��#��#��#r�#��#?�#>�#��#��#��#	�#:�#�#.�#'�#��#&�#��#�#��#
3$]4$7$�G$�H$5I$J$O$�R$$U$HW$}$��$�$��$^�$8�$a�$0�$^�$"�$��$1�$\�$_�$#�$��$8�$`�$B�$_�$��$��$(�$%�$��$m�$�$Z�$��$g�$�%�%�%%N%M%/%{%�%)
%�%*%�%V%�% %�%t%�%=%"!%�!%�!%#%1%�1%�7%9%�9%>:%�;%�=%E?%i?%E@%�@%�@%C%�C%�E%�E%�I%�Z%�[%h%�r%��%c�%D�%!�%e�%	�%��%Ռ%'�%6�%I�%m�%.�%K�%��%��%�%t�%��%+�%��%�%[�%��%c�%O�%��%��%n�%��%��%3�%��%�%��%��%��%7�%��%��%��%�&�&&HE&�F&G&�J&�M&/N&�Q&5R&oR&)S&�\&�]&�^&�^&\a&�a&fc&�c&�c&�d&Ke&�f&Hg&�h&8k&m&�m&Py&>z&�~&�&!�&DŽ&�&��&)�&��&�&5�&��&ޑ&V�&�&��&��&P�&��&��&1�&��&?�&��&��&��&�&{�&=�&��&��&��&�&��&��&�&X�&��&.'4''�
''G'#'o'�'�'^'g'�'H!'o#'�$'�$'�''U('�(')'�)'0,'/7'�<'?>'�@'C'eC'�E'�E'�H'�['�l'�n'�o'q'(r'�r'�u'��'v�'��'w�'��'�'!�'7�'�'�'s�'ۣ'լ'��'[�'%�'��';�'��'��'F�'��'}�'�(�(�(W(�((�((((�)(�/(�1(�;(�=(�B(�B(�G(�H(�J(�O(WP([Q(k(hk(�k(lo(er(t(�t(:y(�y(�{(�{(��)M*�*�*;*�*�*�*�*�**�*� *�!*#*�#*�$*M'*�)*�+*,*&-*2*Q2*�3*7*�<*�<*1=*�>*�?*CA*�A*XB*�B*�C*�C*AE*.F*�F*H*�Q*`R*S*|S*O[*K^*�_*�`*&a*,b*�b*wc*�c*��*��*ɣ*��*x�*��*��*G�*̪*,�*�*=�*C�*w�*̶*K�*��*�*o�*��*��*m�*%�*��*E�*��*x�*q�*Q�*��*��*A�*f�*4�*d�*��*��*��*�*`�*��*�*f�*�,��,��,��,��,��,�,��,��,��,�-�-�-�-�-�--.-�-�-� -j6-�R-�S-'W-_W-�W-RX-Y-yZ-5\-F]-�]-�]-h-Bh-�h-j-�j-�o-p-�v-Cx-�y-}-�}-4-��-��-��-1�-Z�-�-Z�-?�-�-��-��-ݕ-��-��-��-9�-�-=�-z�-͡-d�-��-��-�-v�-ȧ-n�-��-��-r�-�-T�-ʼ-�-=�-��-��-��-3�-�-q�-��-	�-$�-��-*.r.�.
..�.�.�.f.Y .6!.u!.".$".B#.�%.b'.�'.�(.�,.�,.�2.}6.�7.�7.8.�A.[F.1G.=I..J.K.7L.�L.%N.�Q.XU.�V.JW.W.\k.�l.Wm.`s.?t.�v.?w.�w.�y.�z.�.\�.��.r�.:�.P�.)�.��.��.��.��.�./�.�.u�.��.۞.�.D�.�.ң.��.o�.�.1�.��.��.��.5�.��.��.Y�.�.��.��.��.�.��.$�.��.��.M/�/W/b/C/�/Z/T$/�$/�$/�'/r(/)/]6/q6/	7/H8/:/�:/�;/�</.B/�C/�/��/��/G�/��/֙/��/�/��/Ũ/10�/R�/��/��/�/K�/��/,�/��/��/N�/��/T�/��/(�/�/��/��/<�/��/��/��/I�/]�/��/0�/��/4�/Y�/��/��/9�/��/A�/�0�0�0:0P0H0
0{00@0�0
0�0�00�080�0"0�"0�#0�(0#)0/*0�00�10�10=20s30�60�6090�90�E0�F0�L0�N0qw0�~0�0O�0߀0:�0E�0�0ɑ0��0��0m�0�0B�0ٙ0,�0x�0z�0y�0>�0��0@�0��0��0&�0o�0��0ƾ0��0��0��0@�0��0��0��0��0O�0�0��03�0��0�0J�0��0��0��0�0��0��0��0��0��0�0��0��0��0��0��0��0�0]�0��0!1�1�1�1 	1111�121�1�
1�1�1181�1(1�1n 1�#1�#1�$1�*1d-1/1�0111�3161�91R:1�C1�2x2=2�22�2�!2O#2�#2@$2j&22)2a*2�^2x_2]b2�b2�c2	d2<d2re2�g2:m2�m2�u2��2�2d�2҆2��2��2;�2��2T�2�2��2ڗ2��2i�2��2Ҝ2�2c�2\�2۞2��2U�2�2�2,�2+�2��2L�2�2��2��2Y�2�2a�2��2��2��2��2D�2��2��2N�2�2m�27�2v�2�26�23�2�2B�2F�2d�2�2:�2s�2��2�2��2��23{3d
3�3�3�3�3�3�3_3X#3$3�$3w>3?3�@3�B3wD3F3GF3QI3�J3NK3�L3�M3O3�O3�O3�P3�R3�T3�U3�X3N[3n[3�[3�\3�]3�_3\`3%a3�c3Le3e3�h3m3�m3�n3=o3�p3!t3�t3\x3@�3ij3Q�3�3?�3ȶ3�3�3=�3��3G�3��3��3N�3	�3��3��3��3$�3��3l�3�35�3�I4PL4�L4�L4�M4�M4QO4wO4fT4�W4�X4�X4KZ4`Z4�Z41[4]4f]4�a4Zb4e4Nf4g4j4�j4l4v46w4$y4�y4_z4U4�4��4��4��4��4r�4��4��4�4��4�4�p5-s5�s5�t5�t5�x5[y5�y5Y{5v�5Ü5z�5�5��5͢5��5I�5س5�54�5��5(�5�5�5h�5!�5s�5��5�5M�5��5;�5��5��5��5��5��5\�5��5S�5��5l�5�6�6�6/136�6�6�6K6�6	6D#6�%6�%6�&6�'6�16�26'36�36>46�56q66�8696~;6�~6�68�6�6r�6��6̆6�68�6��6�6��6��6��6��6�6�6��6�6��6(�6��6��6��6l�6��6��6��6#�6��6��6T�6��6��6�6��6P�6��6��6s�6��6�6��614�6��6l�6=f7 g7�h7,k7�l7�m7Do7�o7uw7�w7{7�{7 �7�7�7��7+�7v�7��7U�7��7T�7B�7^�7��7a�7t�7"�7a�7B�7R�7��7|�7E�7�7��7d�7��7��7S�7�7�7(�7o�7��7V�7��7�8�8�888�'8�(8�)8+8v-8"l8�p8�u8Uv8�x8,z8�z8R{8�{8=8ڂ8�8��8��8�8��8��8p�8��8��8��8��8��8.�8I�8'�8��8V�8��8u�8��8��8]�8;�8:�8a�8��8�9�959�9g9�9*9�#9�$9�'9829e39�49R:9;9�;9�B9�G9I9J9$K9N9Y9&w9�w9x9�x9z9Jz9ӂ9p�9߉9J�9ݨ9��9د9|�9��9�9��9B�9G�9��9��9�9!�9J�9C�9��9��9��9��9��9��9q�9��9��9��9%�9��9�9��9)�9��9�:�:�:6:�
:�:�:#:�:b:!:$:�%:�&:`X:�c:Fe:pe:�e:�g:fh:0j:$n:o:Xp:�p:t:Ew:sw:Ez:z�:��:��:��:"�:*�:{�:�:]�:Ǜ:�:��:��:�:��:Ө:��:��:s�:�:�:��:t�:��:��:��:Y�:��:a�:	�:��:.�:��:>�:(�:��:Z�:��:��:&�:H�:d�:��:�:��:��:1�:O�:]�:0�:t�:��:�;o;;q;	;�	;�15;�
;;�;l;K9;�:;�;;(<;#=;>;�>;�>;;@;SA;�B;E;�K;�K;�Z;[;�\;)];b;�i;co;�p;�q;r;�u;�u;�w;sy;�y;�|;~};E~;�~;E�;��;փ;��;�;9�;��;\�;(�;��;=�;^�;�;��;[�;�;��;��;v�;�;Q�;w�;��;��;��;��;��;��;��;\�;!�;�;<N<<Q@<�@<�A<�I<dM<�P<mQ<�S<hT<�T<uV<
Z<�Z<D\<�\<�]<^<�^<�_<�a<rb<�b<Bg<i<�k<�l<rw<�x<�|<e~<�<�<�<Y�<M�<܉<��<��<\�<�<�<|�<w�<��<��<ұ<C�<%�<p�<��<��<��<��<(�<��<��<��<��<��<��<_�<��<��<-�<T�<c�<;�<��<j�<�<��<w�<@�<��<��<[�<{�<��<5�<��<�=yF=�I=16O=FO=;R=�`==a=�a=�a=�e=�f={=|=U|=�|=�}=�~=!�=��=B�=��=��=��=E�=)�=��=͙=�={�=��=�=g�=��=�=}�=��=>�=��=��=��=��=K�=��=i�=��=��=�=U�=��=�=��=��=3�=��=��=j�=��=&�=I�=i�=�>�>>�>�>�	>�	>�17>�>�
>�>->b>�>>>0>G>@>	>�>8>�>� >y!>">�#>�0>�[>n^>�_>�`>=c>�c>d>�d>0e>Vf>2h>Ph>�i>Ej>�j>k>�m>po>"s>bt>�t>*u>�u>0v>;w>hx>�x>0y>sy>�y>�{>��>[�>&�>ˏ>��>֐>�>18�>[�>�>��>�>$�>��>[�>�>ڶ>��>�>q�><�>b�>=�>h�>��>%�>��>W�>$�>��>}�>��>"�>��>K�>t�>��>��>��>B�>��>��>��>�>V�>��>D�>(�>��>��>��>��>�?�?P?�?�?9?�?i??A?�?� ?J!?"?�"?H#?�#?[??mG?jH?�I?�M?_O?bW?�l?ln?o?so?Vq?�r?�v?Dx?�y?Rz?�}?w~?�~?��?��?��?��?�?%�?i�?'�?��?��?:�?��?\�?�?��?P�?��?�?q�?P�?Q�?��?��?��?��?��?��?��?��?��?�@�@5@�@MI@tI@�e@f@�f@n@�p@Bq@�q@�q@"r@t@�u@Nv@�v@wx@g|@&~@,�@��@�@ �@V�@a�@��@ו@�@��@֛@Ǟ@�B3�B��B݈B/�B�B@�Bb�B؊BNjB��B��BސB�BW�BG#C�$CY%Cv'C�*CˈE��Ed�EA�E��EϐE�EZ�E��E$�E��E�E��E��E��E��E�E=�E��EުE7�E3�E̳E��E�E��EN�E�E��E��E��E��E�Ei�E��E��E��Ey�E�E7�E|�E�EU�Ey�EA�E�E��E��E��E#�E��E��E��E)�E��E�EQ�Eg�E�F2	F�19FOFF�
F�F�F�F�FDF�F�F�F�F�"FRF�RF�TF�UFVF�[F�[F�\F�^F�}F�~F�F�Fn�F�F,�F-�Ft�F��F|�Fo�F*�F?�F��Fm�F��Fe�F��F��F��F��Ff�F�F�F��F �F�F"�Fr�F��F��F;�FE�F��Fc�F��F��FH�F"�FV�F�F��Fh�F
�F�F&�F��F��F��F�G�GIG�G�G�%GR&G�&G'GJ)G�)G�+G�,Go-G�-G�/G�3G�3G5G�5G\6GI?G@GqAGABG)DG1EG2FGQHG�JG�RGYYGbG[bGOcG�cGAdG�fG_�G��Gb�G��Gt�G��G�G��G�Gh�G��G��G�G=�G\�G]�G|�GU�Gf�Gj�G�G�G��G��G"�Gg�Gk�G��G��GY�G��G��GV�G��G~�G��G��G��G��G��G��G��G��G&�G�HRHTH�H?H�HHH�H�HH[H�.Ht0H4H�@HAH�AH�CH^GH�OH�QH�SHHTH[H\H�\H�^Hv_H�dH��H֩H+�H>�H��Hz�H��H��Hm�H2�H��Hf�H��HR�H�3I�4I[6I�:I�;I�;I�<I'=I?I�@IBI�BIDI5FI�FIHI�HIKIIuIIJIILIMI>MI�NIOIIQI�RIHSIwSIAUIAWI�\I�\IF]I_I%aI�aI�bIYdI�eIfIYmI�mI�nI�sI�JFJiJ1J�J#JlJ�J�J|J�J�J�J:J<J20>J�>J�AJ�BJ4DJ�DJ~LJ?MJ�MJ!NJ�PJ�RJoSJ�SJ5VJ�VJWJ�XJYJ�dJ�dJeJ�eJfJrfJxgJLjJ
kJ�kJXlJKpJ&qJhqJ�YK�cKeK�hK�jK]kKqlKT|K~K��KȈK(�K~�KN�Kk�KЍK��K��Kw�KڐKj�K�K �K]�K�Kc�K�Kt�K��KN�K��K5�K`�KQ�K�K��K��Ka�K��K�K��K	�K>�K�KX�K��Kn�K��K��K��K��KI�K��K%�K��K&L`LL�L�LlL_LKL
L�
LIL�LL�#LP%L�-L(.L�.L
0LA0L�0L1LE2Lm2L�3L5L1:L�;Lz=L�@LSAL�GLtULxWLXLqZLEnL�pL"rLAsL�tL�yL�yL�zL�{LF|L!}L�~Ll�L��L�LB�L��LR�LȊL)�L@�L�LݏL��L՛L��LƜL�L}�LʥL�L��L[�L��L�L6�Ls�L��L��Ld�L��L'�LP�L��L��L��L��L��L��Lg�Lr�L��Ld�L�L��Lv�L(�L��Lg�L�Lf�L��L��L��L��L��L��L��L��L�M�21MPM�M�M-*M�-M).M2M�2M�2Me5M49M�JMFNM�NM�OM]PM+QMeQM�SMoTMNYM�aM�pM�pMAsMzMD�M}�MсM��M��M�MV�M�M��M��M$�M��M:�M£MC�M�M�M�M��MŭM��MH�Ml�MƲM��M��M��MֹM��M�M��M5�M��Mr�M��M��M��M�MQ�M��M��MM�M'�M��M5�M��MU�M��M N�N22N�23N`NkNvN�N�Ni"N!#N�#N%N"*N=.N�0N�0ND3N!BN�DN1IN{INJN'KNMNMNYMN�MN1NNYNN{TN8VN�VN|WN�`NabNjN
kNlN�rN�vNxN8�N	�N�NœNƟN�N�Nb�NɣN.�N��NG�Nr�N�N
�N˲N��Nr�NI�N��NU�N��N��N��N�N��N��Nk�N�Np�NG�N��N��N��NS�N��Ny6O�9O�:O�;O
<O"=O@O�@OEOcEO�EO[HO�IOKO�VOjXO�XO�YOf[O�[O�\O~^Ol`O/aO)nOrObsO�sOJxO�{O0O�OՁO8�Op�O?�OK�O��Os�O��OҙO��Oi�O�OڳO��O"�OV�O��O��O��OY�O��O��O��On�Ov�O!�Ot�O��Or�O��O��O��O��O&�O��Oj�O��O|�Ol�O5�O��O$�O��O&�Oa�O��O��O��O�OW�O��O>�O��O�P�P�PGP�P�P�
PzP3P	PKP�P9P�P24P!P� P]%P�'P(P25)P�)P�*P�*Pk9P?PeNP�RP�SP�UP�VPFXP�[P�]P�rPsP}sPutPuPNvP�vP�vP�wP�wPhxP�yPQ�PI�P��P��P��P��P��P��P