Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00079_00000_shuffled.ds.index28 linesDownload Raw Back to root
1 2h���"!�!3"�*+�+n,�,�=e>�>6?n?RG�H�J�W�X\�\7]�^h_�m�p�q�r6sEt�t1u�v�x�|�}_�����������p�	�N���C���3�O�Ũm�۩z�����Y�������[�@�f��u���]�����}�4���Y�J����<�3���b��
�v���$�/o2q4�4�5�9G;�<X=m?�?�?BB%C�C\E G�JO�SpTbV�V^mon}}�������j�c���֘����q�������A�ڣZ�'�f��*�+�F���ˮ��\�<�������^���h�R��!�!�"H0a���e���ȇ��}�b��;���؜M�	�͠	�������z������!��������������Q������H���V�����?���d�����u�V���-3�4�
g��E�TJ"�&(�)e.�.�/%6�7�7�8�8-9y:�;�=+>x>�@ABCSC�C�DFE&H�HkI3S�Uc�cwgj�o"pq�q�q{r�rltduQy�{[|)~�~��É����΍5��}����q���%����|��¡ݥ�������ݻNr�y({z{�{T}�}�~o�ƀ����b�&�׊���9��2�n��������$�
����ɤ�����U�!�b���{�/���z�����~�����W�����k�����:���F�b���x��H�������S	�_�H
5���a�s1Wu$v&-'(�(a,-�GBH�H�NP�P(SxT8W�WR^�^D_�aQd�fk�o~pGt�t�xz~�~�~����X�7�8����ߏo���&���j�����j����>2@�QRZR�S�TdUwV�k�l�m�m�o�pr v��Нޞw�Ѥ����R��k�f��������s������,�����4���2�>����������-�r����������h���=����6C�[�q�u-}s�X�����S�����6�����������/�n�*���~�Ұ������)���P����?����!����������}�n���o�Y���]�������)���������������������+�/������D�����
�y4����a�3 �$@%z'e*/+�+L,�8`VWVXjlAnFo�p�x7y�y<z�z-|~~߆8�Ljk���(���������������k�����|�]���=�����?�����	�����������#�����V�n�g�����������Z����O�=���+	L	#	�	0	�	�<	F	kG	�R	�S	�T	�U	�Z	,_	V`	*a	-b	ne	Of	�f	2g	�g	&i	�j	*l	�l	n}	��	��	B�	�	��	�	i�	�	��	�	��	�	:�	l�	ܛ	'�	9�	��	E�	��	�$�H���_�$��.�G�P�������,����e���7�M������������x������f�������������K�#�]���5���>���h
8




0
>
�
k$
+'
�'
�(
7*
|*
W+
�+
�+
�9
X:
�;
C<
>
}?
�?
�I
�J
�J
PM
R
;S
�U
�Y
�\
o�
ܗ
N�
�
�
W�
<�
7�
q�
��
�
��
��
�
�
��
��
�
g�
��
��
��
F�
�
Z�
r�
�
�
��
��
��
��
�
=�
p�
c�
A���������i�j�m2p�xby�z�{e~������/�D�v����P���e����{����	�������d�������h�f�������[�'�i�S�2�%�������v��������,�u4N�8z��$��w#j#�%�*�7N@�IK$OsP�V�W�XY�YO[7^(_Ja�a�codXg�i`|�}�~\�+��ݞժ����,��ӳK��!�ʿ�#���<��'���1���2���&���K�*�t��X��������!@9
��v��1M]M�M1VxW�Z�x0y�y|�|��������ߊ���ڒΓ�m�`�����աZ�X�¥-���֪@���V�:����_�^�����^�����Y���n���p���2���V���������������?�l���.�@��������V����10�116n�
Nm����"�%$'X'�)�*�,l-]/�/�4+5]5W7�7u=�>�@�@�B�B�B�D_F�I�K>L~R�RcV�VIX�X�X�Y6ZS\�]�dOhsi"k�k�n)r]t�wxƫM�J�=�,���'����ֽ���`�3�_��N����k�'�^�w�d���l���������������O�u�����
�
�\>?�}�$5%�4 6�7EE&M�MO8O|P12QVYgY�eIgVi�i�l�mAr�t�w$z�{�}�~��i�Q�����͗{����h�Ȟ-�M�0��������2���g��X����N������������_�&�}�������D��u����s���b�div�w4y�y_z;~90����G�?���'�������������@�I�G�E���s��m�	�������[�������?����������0�	{�*H�"$) �!"�'H*�* +�/S0�0Z1P2�5�G�G�H�H{U�V�ViZ13]�]ns�tv�wiy����ƏY��L����������������	�X���7�n���=��*�c�����������X��n�k14S� � �#�051O:�:�B|L0THT�U"V]Z�Z+h�j�m-n�u3��3�����	�15W�bE��71G<z<D?�B�B�CD�EI9I�T� � � m �  : z � � � �  �5 6 7 �9 g< �< �> =? �? 16@ 5B RE G tH �H UL �L #M �P �P gQ �Q hS T 	U �V �c �c �e f 4h �l V � -� � S� � B� � ݐ H� � � f� �� d� � ͩ >� �� z� 0� � �� [� �� � �� #� �� � �� n� l� %!3!�!�!
!�! !@!u!�!�!.!�!!�'!�*!�+!�9!;!�;!<!s<!|M!LT!�U!vV!�V!&Z!i!Pi!�i!(j!k!�l!8o!�o!�p!�r!t!lu!�w!Ux!�y!�~!�!��!#�!~�!�!&�!ך!A�!��!ۧ!��!�!��!'�!��!�!��!{�!	�!��!�!��!q�!k�!��!�!��!��#C'rF'�F'G'IG'�G'�G')H'�H'�H'4K'L'IL'o`'c'�f'17g'<h'�h'�'�'"�'�'n�'�'a�'�'.�'�'��'3�'`�'��'��'�'�'�'Ŀ'��':�'
�'�'d�'R�'��' �'�'��'��'b�'[�'��'G�'��'��'I�'��'/�'q�'��'��'��'��'�'Z�'r�'~�'��'��'�'��'/�'��'�'��'�((�(�((z(r(�(1(W (�!(18'(�((�*(�*(N(�O(}P(�Q(JS(�W(X(�i(:l(m(�o(�o(�p(Tq(�r(�t(u(�u(�u(w(�y(�{(Y}(?(��(ۛ(9�(��(�(��(w�(�(�(��( �(��(�(D�(a�(K�(�(�(�(j�(}�(��(�(I�(T�(��(��(d�(&�(��(��(]�(%�(N�(��(��(��(��(��(��(��(��(��(��(9�(��(��(��(��(H�(��(��(�,)�4)�6)D7)O8)k9)^;)�H)I)sI)8J)yJ)�J)L)M)bN)�N)�N)O)�O)T)�T)�T)�U)�Z)�\)�])�f)g)h)Fi)�j)k)El)al)pl)�l)�y)�|)-�)��)��)R�)��)��)[�)J�)ӥ)��)_�)(�)z�)˰)��)j�)"�)��)p�)��)��)��)�)��)�)X�)?�)D�)��)��)W�)��)�**�*�*�	*_*�*�*P*O
*w
*T***k*�*a*�**!*3F*G*�G*J*�J*�M*}N*+O*�O*P*lP*�Q*�T*�Y*�Z*[*�[*&]*_*`*Ba*Fb*�c*�d*{f*qh*,k*�l*�o*�o*��*ڀ*X�*��*��*�*|�*�*Č*"�*ۑ*��*�*�*�*��*ȟ*��*�*��*d�*��*g�*��*��*?�*w�*�*ͻ*��*K�*Ҽ*~�*��*"�*!�*Q�*#�*��*��*6�*��*�*��*��*��*��*�*H�*%�*p�*�*e�*��*��*2+�+.+h+
+x
+i+$+�+-+�+�+R+*+P+M$+�'+�(+�)+g/+�0+F2+]3+�V+SX+�j+�k+Fm+�n+Qq+Dt+|t+Dv+�v+�x+y+V|+j~+
+�+4�+��+s�+�+�+��+U�+T�+"�+��+p�+��+��+m�+y�+��+7�+h�+k�+�+��+��+<�+��+��+ Z,�^,�a,�f,�q,tu,�w,{,y{,�{,},�~,��,,�,��,�,��,,�,U�,��,�,��,�,��,��,�,�,͙,?�,Z�,��,��,3�,��,)�,R�,��,�,�,��,��,&�,��,ǵ,�,ϸ,<�,#~-�~-^�-Ҁ-^�-��-̓-΅-5�-��-A�-^�-��-�-%�-��-q�-��-1�-�-.�-��-��-N�-��- �-��-ƭ-��-��-$�-��-19�-��-{�-��-��-�-��-��-��-��-��-B.1
.[
.�.[.�.F.�.�.U.�.�.� .3".�$.20%.�&.�(.�(.�).�).3,.�,.-.21.�.�._�.�.e�.\�.��.3�.��.��.��.B/�H/iM/�N/�]/��/6�/.�/s�/��/��/��/�/�/^�/��/��/_�/�/��/[�/\�/�/�/��/�/�/y�/��/��/N�/x�/�/��/&�/��/��/?�/�0
0�0�	00�0�)0�)0�*0�+0�.0/0�20�20�40o60�6070hH0�J0nO0�O0mS0`T0
W0�\0�\0}h0�j0Tk0�k0Dm0An0�p0�q0�w0y0Ay0��0�05�0��0��0ٍ0Ȏ0��0Ð0��0��0˕0t�0>�0��0�0��0��0�0W�0��0��07�0t�0�0v�0��0��0��0��0^�0��0+�0��0t�0��0h�0��0V�0��0#�0A�0��0��0��0��0��01Q1{1�
1�1�1�1l1Y1�1�1�1�1|1213=1S@1PE1�F1XG1�G1�G1�G1�H1�H1_K1�N1O1�R1pS1[Z1�[1	a1�a1nb1�b1�d1f1Ih1�h1�i1�n1%p1�p1�p1s1os1~s1t1�t1Xu1�v1�z1.{1�1!�1��1f�1�1��1�1��1͜1L�1�1��1�1k�1ȵ1&�1y�1�1�1��1|�1��1��1�1��1*�1b�1��1��1��1�1+�1��1`�1O�1��1�2}2g2m2�2,2�2�	2212�2�23
2�2�2J2�2�2$2n2�2q 26"2o#2$2J$2�%2�%2_(2*2�,2p12�32:62�62�62x82�:2�;2�<2|=2>2?2�?2�@2�@2A2hE2�E2�G2I2bI2�L2>M2[O2�O2�O2PQ2�U2{V2�]2�_2v`2�`2c2Kc2_d2<e2�j2jk2�n2'o2�o2)z2{2�|2�2[�2*�2��2��29�2�2��2F�2-�2ݓ2O�2��2��2	�2/�2��2)�2��2O�2�2�2��2k�2I�2��2�2^�2�2i�2K�2��2�2��2Y�21�2�2x�2��2��2)�2B�2��2I3w3�3�	3223^3
3�3�3�3e3�33�3	3)3�3�3G3�3�3�33�3�3a 3K<3(=3P=3NA3�C3�E3�K3�\3n^3�^3�_3�_3`3cf3}p3�p3�r3vu3#v3�x3�y3�z3{3V{30�3B�3��3�3{�3Ґ3��3��3��3}�3��3n�3=�3��3W�3#�3(�3j�3�3��3�3��35�3��3�3��3��3�3��3��3r�3��3L�3r�3��3��3��3��3h�3-�3b�3��3��3.�3��3\4�4H4�4U	4$234�4P4�4�
44�4�4|4�4�!4#42#4b#4�#4�64%84h94:4�:4(?4�?4'@4�U4W4�a4�f4�f4}i4�j4ym4pn4Xo4l�4��4�4u�4"�4:�4��424�4�4!�4��4;�4ݢ4h�4��4/�4<�4��4o�4q�4R�4G�4��4Z�4��4ȹ4
�40�4��4u�4�+5�.5�/5R1525�95�:5�;5�?5C5TH5I5�I5�J5fK5�L5,R5�V52Y5�Y5	Z5/[5s\5�\5M]5�]5�_5�`5a5�a5#b5Ec5�c5Qf5�h5Cl5�l5rp5�p5�p5cu5v5Wx5Yz5�|5�|5�}5{~5��5�5��5��5ث5o�5��5?�5��5��5��5b�5i�5��5��5>�5��5I�5��5"�5V�5<�5��5q�5��5�5V�5U�5x�5��5r�5��5�5��5��5%�5��5K6�66$
636Y6�6�6~6�6�6b6:6�6�6@60"6�96{;6�=6.A6�B625C6�C6�J6i6�o6�q6�q6�s6�u6�v6Fy6{6�|6�6g�6�60�6��6��6��6?�6��6�6J�6d�6"�6?�6�6�6��6)�6s�6��6�6��6}�626�6��6��6s�65�6W�6��6�6_�6Z�6��6��6��6��6��6F�6�u:8{:�{:|:}:�~:��:3�:�:��:E�:�::�:�:��:��:�:��:i�:�:K�:w�:�:?�:ݞ:��:�:֢:I�:�:ۧ:~�:ɨ:1�:��:�:Ϋ:��:��:}�:��:�:'�:�:��:>�:��:�:@�:�:a�:��:*�:��:�:q�:u�:R�:8�:N�:��:��:L�:��:��:��:��:l;K;
;�
;;0;(;�;8;�;�;�&;�&;.(;�);.;=.;�6;
L;wV;�V;�V;27Y;�Z;�Z;�\;];I];�h;�j;�j;	r;�r;�t;�v;:x;Fx;h};��;N�;�;��;��;��;��;-�;p=Zu=Pw=�y=g�=�=X�=ݒ=F�=ӓ=V�=4�=��=��=3�=�=�=ͻ=��=P�=��=��=��=��=a�=a�=��=K�=��=4�=��=��=a�=�=?�=��=��=��=�9>�<>�=>�B>NR>S>�T>	W>�[>�[>�]>�^>W_>7r>�u>�v>Qw>y>Py>�y>{>P{>�{>ւ>{�>�>��>��>ʉ>��>H�>k�>��>5�>�>ϸ>��>L�>��>W�>��>��>U�>��>��>��>n�>��>q�>G�>�>@�>��>}�>$�>��>��>6�>��>
�>��>�>T�>��>��>�?�?9?�!?�#?�$?%?��?ɩ?ګ?$�?28�?�?��?
�?x�?��?k�?�?�?��?��?�?g�?�?��?��?�?��?��?@�?1�?��?�?��?��?��?��?P�?3�?��?@�@I@�@�@@�@#@�@s @�!@�#@%@&@�'@�'@�*@�*@-@�7@�8@�:@;@H@TI@�K@�X@<�@у@�@�@U�@�@��@��@ �@n�@?�@	�@��@#�@��@S�@��@��@��@��@��@[�@��@E�@;�@��@�@��@��@��@;�@b�@��@*�@-�@q�@l�@:�@�A�AAA�APAS$Av+A
,A],A�-A�-A�-AT.AZ/A�/A�1Ay4A7A�AA+CA�DA�MA`NADQA�QAdAWdA�eA�kAlA�mAoA�pAEsB tB�zB�{Bz|B~}B�~B/�B��BL�B��BǍB�Bo�B��B+�B��BٞB��B�B=�B$�B��B��Bd�B��B�@CSCC�DC�IC�LC�MCvOC�OC�YC�ZCk[C�[C�]C�^C(_C�`C