Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00071_00000_shuffled.ds.index16 linesDownload Raw Back to root
1y./2�758+>b>A�Lg`�`�a�e fbi0jZj�k�m�n���������{���D�����������;��o��K�\�ϺһZ�����=�~�.�@���'�1���u��z#�)U.�/�0R1�3�5�6�7�8@:�::AUF�I�I�LO1OaO�Q2R�VX�Zr[�[�[$�b��9�����n��@�������������!�B����ֽ2�ܾe�[�\��������w������l�s���B�j����������<�w�|���G���t�b���t�E��K|�
=�f�8�;<M?1@�A�A�B7G�GI�J�KbO�O�O�P!Q3TU	Y=Y�Z�[�[H\t]�]:^�bdـ�E����p�v����H�����֭����ذ1�e�ٹ�K�����������X�u��������������������[�T�+g9h�h`i�kXrhs%ty�{�~�������S�؈��C���Ӎ�G�q�x����Ů���c�p�ι^�����`��4�|�`��W�,Vb?e�e5f-g�hNik�kNm�n�o�qs4t�x�z[����}�R�ŗ��C�3�)�g�M���,���S�V���N���x���.�����������R���I���~�G�������W{����S� !D!1+�+�,�,Q/4�4,7�<ECG�H=I&KQW�WeXpY�Z�]�a�ij�j�k_mtmp$r�rx�(�C�Q���y�]�*�ې��"���*�o�ڭ����I�����(��������{�L�����$�,������6	�x4�5X�G����D�'�)�+�,�0�1�2�2-3`5�8�:�;�@TT�T���X�����5�Ҥ5���U����B�2�6�����|���7�T��/j
2��|�S�6���H�������z���.����~���2����'��7n�}� "�(8)�-�7q8�8w:;�=�A�BhK�KN�N�Q�U+V�V�Y�Y�_�`kl6m�m@r�u2z݆���ō�K�����|���R�ә
���h��;���2�������U�����������{�^
�
B�Van�u
 A!�!�F@H�J;KIL�M�NPQV�W�XYY�Y9ZE[�d�j9k�k�k�p8u�v^w�~���ɀ����Q�)���>���ʍ�ה+�!�����̤���ڪ �Ϭۭg���ڷ� ���m�`�����p�C�y�E��R���\�3�[�&����P�����������K��cE�E�F2G�GH�J�KIM;QRdR�R�T1W�Xe3f�vy,y({H���Y�'���#�`�ߏr����~���;�F���1�9�X���w���������0��S�����������"
W�!#�#�%�->.�/|;?x?p@�E$F�GKJMLHM�NGOtP�U<XY^"`�`=iWj�n�n�o3q\r�u�t������߇h�7����؛s�d�����������:�"�C���M������������5��������>���u�{���N�F�W�������+���]�3�<h�c�P 	#Y%D&�&�)�*,./�0�4�6�7�8U9\;�;�<>�>%?e@�D\E�E�E~G|IeK�P�P�Q�QER�SIUxU�U VrW�WhX=YZiliUj�m�m9n�nJo�sCt9{W|�|J}y}�}m~���{���$������$������X�����@�e���&���շ��E�:���ڿ��9�V�����o�O���OScT�VSW�ZJ\�]�]�a�bycRdKh�kymkoTp�pLq:r�r�t�u�v5���K��c�����m�6��G���Βؗ�����S������(�Y�٠�����n�Ш��z�2��v�ְ���|���Ƽ>�Ⱦ��F�������b���#�V�b���y��������Z���0����
 �
 � 6 � � �Q �T �c �d j k �m 8r �r �r Ds �v �w �!<!f!8!L
!�!l!�!�!X!4!9!O9!�9!�;!�=!�>!�?! @!H@!�@!8A!H!%H!NJ!9K!�N!�N!tP!�P!CR!�R!�V!&W![X!�X!7Y!�Y!�i!�j!6k!tm!�o!kp!�!��!օ!݇!��!�!q�!��!'�!�!��!R�!͓!9�!��!��!<�!��!U�!�!+�!��!��!מ!��!�!"�!ڥ!X�!��!��!c�!o�!h�!�!	�!��!��!>�!��!��!V�!��!:�!�!��!��!5�!��!��!z�!��!<�!x�!��!��!�!��!:�!B�!��!i�!��!��!��!_�!]""_"_""�"x"!"Q!"�"")#"n("0+"{+"�/"�0"�1"�2"�2"�6"7"O7"O8"M9"�9"�:"1;"�;"�;"�="�>"�@"'G"N"sN"�P#NR#EY#�Y#�\#�b#�d#Af#}f#�f#�g#�l#�o#�o#�p#�p#�r#�r#�t#Mv#�w#�{#7|#�|#�#�#p�#�#E�#ځ#�#��#͉#��#<�#��#i�#��#͔#Z�#��#��#��#y�#��#t�#٧#}�#��#��#η#�#{�#ۺ#��#�#[�#/�#��#��#��#��#%�#��#��#�#_�#l�#5�#j�#��#��#��#B�#��#.�#��#��#'�#��#"�#��#��#'�#��#��#��#�#�#��#�#F�#j�#1$�$�$�$�$$$�$~10$M$�$�$�|$l}$��$�$�$��$��$�$=�$'�$��$�$ٛ$�$��$'�$B�$��$��$��$�%T%�%8%Y%u%�%U+%�+%m-%�/%�1%^2%�2%�?%�@%�A%oN%�O%#T%U%UU%|V%'Z%G[%�]%`%�h%i%�i%o%cp%q%<|%�|%b}%��%̆%:�%T�%ޔ%��%�%��%��%+�%��%5�%��%��%��%^�%��%��%��%�%<�%U�%��%U�%��%��%�&T&�&&'
&�&D&�&�&�&�&�&3&c&�&�&� &�!&"&%&(&�3&�4&6&�7&�9&�:&�;&t<&�G&kI&pJ&E\&�\&�\&�b&/d&�e&j&�j&�j&�k&n&�n&Xo&Ct&�t&�x&Vy&�|&
}&�~&�&d�&��&��&�&��&�&j�&��&�&~�&��&�&�&��&��&ܬ&v�&�&�&��&?�&2�&��&|�&��&F�&��&�&8�&F�&Z�&��&��&��&�&��&��&��&��&'�&��&��&F�&��&^'G':'�	'&'
'�
'f'*'3+'{-'�.'9/'�/'�1'�4'75'�6'�9'�9'1:'O;'�;'�<'�<'n='�@'�@'�A'�B'�D'{G'�G'T'�U'V'6W'�[';\'W]'�^'�_'`'c'�d'zf'xh'Dj'<m'�m's'�s't'�t't|'�|'~�'ʆ',�'��'f�'e�'��'ʋ''�'��'X�'�'ە'��'/�'ӗ's�'�'ݜ'�'��''�'��'��'�'o�'��'q�'ì'�'��'��'��'��'s�'��'�'S�';�'��'>�'��'#�'��'��'��'��'�'��'W�'s�'��'p�'��'8�'��'��'��'��'�'��' �'��'��'4�'��''�'��'^'(\*(�*(K+(�+(_-(e.(�.(M1(D5(�6(�6(�8(q9(11;(�=(�=(�A(�A(�C(eD(�D(�L(N(Q(�S(�W(�X(�Y(Z[(�[(Jv(�v(~(u�(ц(͇(}�(\�(��(ٌ(y�(��(>�(��(T�(s�(�(��(i�(��(�(p�(ή(v�(�(��(�(�(Ͽ(0�(O�(��(��(+�(��(��(�(�(��(?�(��(?�(��(Z�(��(��(��(�(��(��(�(��(u�(�(S�(;)�)	)�)�)�))K)&#)0$)�$)()u*)�>)�B)BG)XZ)h[)A`)*e)��)d�)f�)��)!�)
�)�);�)]�)3�)��)$�)��)�)��)e�)O�)Q*�*)*e"*`%*�%*A'*�'*�**�,*M.*0*_1*2*T5*�=*�?*A*�A*NC*�C*�D*aH*�H*�K*EL*N*&N*�Q*YU*~U*X*qX*�Z*�_*�b*�d*��*k�*��*{�*�*=�*��*��*�*W�*��*#�*c�*��*\�*
�*��*8�*��*&�*�*��*��*G�*��*]+v+Y+U+�+�!+g"+�"+#+�#+B++t++�,+.+T>+�C+F+WF+�G+L+=P+�Q+S+8S+
W+�]+�_+�`+a+bf+g+9�+��+\�+@�+�+��+�+��+��+T�+��+��+��+�+u�+��+��+k�+��+I�+��+��+W�+I�+Y�+��+>�+_,c,�,#,�,\,�,,�,,,�%,�),�*,$,,�.,@/,�/,�/,R0,�0,�1,B2,�6,B,bB,�B,&C,2E,F,�O,�P,�Q,�V,aX,�\,�],�_,Wt,�t,Pu,{,Z{,�{,|,�},-,�,+�,=�,��,��,�,K�,i�,ˎ,%�,��,��,ȕ,��,��,F�,&�,�,��,��,V�,��,ɤ,�,�,��,�,C�,�,%�,��,ׯ,2�,˰,l�,��,��,��,�,M�,<�,��,��,��,��, �,j�,a--�-q-�-�-"-Z-�	-�
-�-b-�--�-%-�-�--�-2"-&-�(-�(-!)-+-�3-�6-�8-u9-�9-C-3f-�m-�q-Ӆ-��-ݠ-��-��-s�-0�-̹-�-Ž-��-^�-��-L�-��-	�-D�-��-��-��-��-��-B�-��-��-��-��-��-�-��-{.N.A.�.�..v.�. .#.	$.3-.�/.0.w7.�7.y8.\:.�=.ZI.iM.Q._Q.R.�[.\\.|].a.ne.�h.�l.�r.�s.!�.�.��.�.��.	�.��.v�.�.|�.��.��.ײ.n�.Ŵ.ù.��.H�.��.��.N�.��.�/�/!/�/1/�/�/& /� /� /�#/2%/#&/n'/C(/j*/�,/m-/../�//�//�0/?1/2/%=/]=/�=/�=/�>/u?/�?/@/�@/�A/DB/#C/HD/�S/T/[W/�W/[/]/{]/�]/^/0^/J_/l/8o/�p/zt/u/�v/�x/�}/I~/Ё/�/+�/N�/�/n�/��/W�/�/ݩ/ �/D�/��/S�/��/D�/u�/�/$�/v�/��/�/��/�/�/��/��/f�/�/��/\�/��/��/�/��/w�/��/)0�0D0T0�0�0B00n00�0�0""0{+0�-0j/0�2070�70@0A0A0�A0�C0D0%E0{F0&G0�K0)M0vP0,U0}U0�U0bi0k0Ql0zq0er0`t0k{0�{0�0S�0+�0܇0�0��0�0�0��0$�0)�02�0j�0n�0)�0��0��0�0�0��0��0E�0\�0��0�0Y�0��0�0~�0}�0��0��0U�0Y�0P�0��0��01�0P�0��0!�0A�0��0^�07�0��0�1&1�1y	1x121�131s1\1�1�1�11�1�11p1�1�$1s&1�&1�&1�&1\'1�(1�)1�)1�*1A+1�.14/1�01�51K71�;1y<1�>1�@1�@1&B1iC1�X1:[1Sw1�w1z1�{1�}1��1x�1�1�1��1W�1��1��1T�1��1�1š1ݢ1ԣ1�1�1b�1y�1��1��18�1��1��1i�1_�1��1t�1��1�1�1��13�1t�1�1n�1��1[�1��1��1�1)�1N�1��1��1[�1��1�1��1�1�1(�1��1H�1��1��1T�1	�17�1��1��1��1Y2�2�2�
2+2�,2�.2�/2�02�>2.?2�A2sC2IH2�H2�S22U2WW2�W2�]2L^2K_2�_2!b2�d2bl27t2$u2�v2Gz2�z2�z2�}2~2�2F�2ˆ2��2Q�2��2�2	�2�2p�2Ӥ2�2ŧ2{�2�2��2��2�2�>3�>3>?3CB3qJ3�K3�N3�P34R3.S3RU3	W3�v3+w36x3�y3{{3�{3�|3#~33`3ۀ3�3��3�3#�3y�3ژ3��3@�3u�3�3 �3��37�3��3�3O�3��3��3K�3��3��31�3��3T�3�3�3G�3i�3��3|�3��3�#4�%4R&4?'4+4c+4�,4>-4�-4'.4�.404I04c24�24�24v64�64!74�84�94�;4�;4>4:C4�C4qD4�D4�E4DF4EG4�G4�I4]N4�U4SX4�X4�Z4[4!\4�\4B]4__4�_4Ub4�k4?l4�o4�p4q4�q4r4��4-�4��4�4��4P�4��4!5(5o55`5r	545�5�5E5s5
c5�d5�f5g5ig5�g5�g5�j56m5�m5%o5ss5�s5�v5�v5�x5?}5~}5ƃ5��5�5N�5��5��5Z�5��5��5��5Ԓ5�5{�5��5<�5��57�5դ5�5�5��5E�5��5/�5��5�5��5r�5L�5{�5��5��5��5��5��5g�5��5��5a�56v6�66�6P6�!6s"6�"6r#6_$6hM6�M6/Q6�S6�T6�_6�`6�a6�c6 e6�g6)h6�h6��6U�6��6�6�6e�6��6��6�6v�6��6��6��6�6&�6��61�6��6'�6��6��6��6�7M7�7�7#7�7�7(7�7�;7LB7�B7^K7�O7�Y7�Z7�[7�b7�c7�i7Ql7`m7�m71o7q7�r7#s7Cs7�s7t7�w7�w7�x7Ȇ7r�7o�7Í7_�7��7��7#�7��7��7Y�7�7�7�7��78�7�7=�7x�77�7��7s�74�7п7��7H�7B�7��70�7�B82C8�G8�H8�I8�I8FJ8�T8�U8�[82\8�\8�\8&]87^8�^8=_89b8nh8�m8�q8�r8}x8;z8�8��8�8��8<�80�8�8��8$�8N�8"�8y�8�8B�8��8�8Ƴ8[�8��8��8A�8��8n�8��8!�88�8��8��8��8O�8|�8d�8B�8��8��8��8�8
9/9�9�99�9x
979�$9�&9%'9.9�.9�/9�19f29�99�<9=9�=9US9�V9:Y9Z9[9d\9�]9^9�h9�i9j9�o9ds9%w9�x9�y9<z9iz9(~9�~9��9׃92�9=�9��9ŋ9��92�9�91�9�9f�9��9g�9"�9��9�9q�9��9��9��9��9;�9ۨ9�9«9­9�?:D@:[A:�B:�G:�I:�K:mO:<g:.h:�h:)i:-j:|k:Cm:�m:n:-o:to:r:�u:qv:�v:Hy:�z:W:q:g�:��:��:��:�:&�:��:M�:v�:X�:�:��:&�:%�:�:�:ͯ:�:�:2�:�:��:��:E�:��:��:��:��:�:��:a�:��:��:��:u�:��:��:��:��:��:��:]�:�:��:��:��:d�:b�:J�:��:��:��:d�:}�:�	;V14;p15;1;K;�;x;(;Y);�);�*;�*;�;;7C;P;�P;v^;�b;�b;]g;qi;�j;�m;�q;�s;�u;y;�z;�z;t{;�};;ځ;R�;ڍ;۟;��;b�;��;��;��;Q�;��;�;٪;p�;ʮ;T�;E�;�=<�><@<�@</B<N<�O<P<.Q<�Q<�X<�Z<�[<(\<�\<�]<�]<�`<�b<�d<1e<n<�o<yp<�p<�w<�{<��<��<��<~�<��<n�<ѯ<	�<�<��<I�<��<E�<�<[�<-�<��<��<��<��<\�<��<"�<x�<Z�<e�<��<*�<��<��<��<i�<�=f=�=�=�=�=�=�=i16=�=�)=m.=�0=_1=t�=��=��=��=�=��=��=}�=��=G�=��=;�?I�?t�?�?�?��?��?A�?y�?��?��?U�?9�?p�?F�?-�?{�?��?u�?W@�@�@@�@�@!@
"@$@R&@�'@�)@@*@N0@oL@�U@HX@(^@Xa@�b@yc@�d@�d@�h@�j@�k@:l@�l@�n@2o@�p@jt@�w@�{@M|@�@:�@�@"�@u�@��@h�@%�@1�@M�@��@�@&�@�@`�@��@�@��@ף@�@�@3�@��@�@��@��@d�@��@ŵ@2�@Ʒ@�@F�@i�@��@��@L�@1�@��@��@)�@U�@��@��@�@��@��@M�@��@��@?�@��@_�@A�@��@ �@4�@K�@��@z�@��@&�@��@$�@(�@��@'�@��@��@�AAA{A6AAA$
A�A�A