Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00093_00000_shuffled.ds.index61 linesDownload Raw Back to root
1�r&n��� � !�%&�'6)�*x=>�CFE%FaG�G/J�M�P�R�TVV�]G_?`�`Rb<c8d�dgm�oMr�rtzv�y|����G�����=�>?G�G�H�InL�L;MnM�MN�OR�S�~�����"�d�3�K��֬���A������������+���	�P���Z��z>
�
�
(�s�nu���$%�(P)�*�+�.0�0�0�6~8<<�=|>�@MA�F�N`O~Q�T�V�VTXY�Y�d[ehsj�l����w���m������ݯ���׸����������Y�	���B�?�$�	�2.���
3�v~%P'�'<)�)�)ԃ�d���݌���ݓ7�Ӗ;�Ԛ'�x�ߠ{��;�ӫ�0�0�24'6�6�9@!@�@�DG/HFH�K�LN����*���:���G���������N���/�b�������;�G�i�������ED"�����V �!�!b&�&�'4(?)z-�1�56�6!@;@�@ABKvM�N�NOyU�UBVlV�b�h�o�q�uvE~<���̀��Ɋ����<����+����R�Õ���N�,�������:�V����/���^���Z��;�l��{�"aQ3i��HE��.�\��!�'�,�-�0:2Agdh�k<m�m�n�n�p�q�r�swtuw�w;y�|�|a}E�B�t������W�'.�.d4�7�:);V=�DYElGKI�I�J�L2O�O�S�T�T3VWd�d�t�x]yt|�~��j�ɂ��%�����0��ȑ?��r�A�S���,�����m���y�D���/�1�i�@�T�����X�X�b�C����J�\������n�O>	:@	�@	�@	�@	OF	H	�I	�N	YO	VP	S	KU	dV	�V	W	pY	�Y	�Z	w[	 ]	�^	N_	�_	�a	�k	Xn	�n	�p	3q	�q	�t	�u	v	y	�y	*}	^}	�~	ӂ	��	7�	��	v�	Ѷ	 �	r�	��	��	��	�	��	��	��	\�	��	$�	��	��	��	��	��	��	9�	�	��	��	�	��	��	_�	`�	�	��	��	��	��	��	|�	��	u�	��	��	�	46
5a67+8�%9�&10s'11�)12�*13x@14NA159O16"b17yd18��19�20��21�22B�23n�24B�25��26E�27*�28-�29
�30j�31��32f�33��34��35_�36��37p���9uz�%�)]2z2�6�=2>oE+FGGG�T�U�WkY�Y�Y&]j]-^_�_/`�`�a(b�b�bcd�d~e�g;ln�o,w�w	yUq���w�������������,�����d�c�R������0��������ks��5�� Q"$x')�9�:i<+CFG�G[K3WXl\�]p`swx
~�[�ƃ{���L�؈��Ή>�L����-�����Ǟ��r�@�=�^��ϰ�����}���X���i�J����������������:����\�����"�j�n�r���Q�������h
�
�
*

�
�
�38
9
�
�
$


L
"
d"
�'
+
�-
�-
{/
u0
31
3
�S
H^
?a
[l
�l
p
�s
Lt
�t
!u
�u
Rw
Bz
G|
Ҁ
��
م
r�
6�
Ȉ
č
_�
��
o�
�
�
i�
Х
��
ܪ
s�
�
ɲ
U�
�
Y�
��
/�
�
��
5�
w�
�
��
Q�
��
�
(�
��
m;�=�=t?�?<AC^i�jRp�p�rWtxPzn{����Ђp�҆����������a��S���=�I�@�˿)�E������g39Y40�41��6r9:�;�B�IK�NGOP�P�P�R�S�������
�9���
���0�f�]�2�����H�������������<��������u����;�������������t����!�*9.�K�L-M T[T�WCYL\�\�d�eh�i�jvl�lHptst�u�y,z�{(|8��ÖM������$�0��Y�߻����0���Q������|���t�+���e�����N��=V���"�%@&�)�)u+,g2�2�5P<�<�<�=>�?A�JPL�L�M�OQ�S UjV�WXo^�^s_�_�`�aIbcd�fn+r�ru�vewzx*z�|�|�}�}P��#���8�L��Ү��߱>���D�����C����>�X�����C���b�����!��\�R
z
%,%?'2)�+�-/�/<8�>42BpB.DiD�E
F�G-H�IM�M�Q�R�VX5b�ef�f�g0hjUj9nwJx�y�z_{�|o���ρ
�9�t��ޔi�,���c�2����� ������	�
�Nv�a3��)i*^+�+2,V6�7�9!:�AmH�HBIc#c�n�n�o�t�t�u�wgy�yGz�|}~}o����S���Ǎ"���������0�3�^���Z������p������p�o��: �;gE�E#FbF0G�H�j�p�qar�rrsyPz�z�}�}6�w�K��Ñ<����������f�Э��Ҽ����~�:�,�@�b�����/���	�������O�h���c������������F���D�Y������V�'�5i�	�_�A�b��S �!##�)�/[0�0�12d4�9�;�=�=~G�HjR^U�U�V.^�d�gyh�hEjk�m�n�o�o�qCs�syu�xy�y=�B�b��8�������#�س���"�d���<���)����L��J�{�v�z������1�����1�U�	�	�-
R�c�&!�!#"&%1�3>�>sA�F�IESRVfWJ\�\`a`�`,ewf<h�o�rvz߀��������#�����00=9z%43BZ�&���[�]3� �&)(y()�*K+�+�-�.'4�5l7z>�>�AC�C-D�L*R�UV@[�^�_�aejt�v�z#{�@��l�ύ�C���{���ۘ�j�����U�u�T�������E�̾����@���j�r�S���*�n�I��	(c�i
�_m��� |"#%-&S+G-�01�3�57�8�?�?BC�D�D�EGPJwJUKvK�K�M1N�ZH_�b\f�f�g�j�k9�ʨ�3�x���y�������-�~��������������d��`����n���`�:���J����s���m�����
�O�����M���	�p'�'E.\0�0�;;<�>7?�@HCDhD�D%GOZO�O�P�P�Q�Q7S�T�X�_N`�bNc�c{i�st^u�v�v�vTxp�;�q�q������44�!���әM���W���՞Y�{���ß͠������T�{�������Ŵ+�8�L���ŷ��-��=>�?�@&A�A�ANBE�F�K�KCT�UV�Wc�e�e�f�hgw�x�xYy{j��1�4�t�͈�ݐa�Ô ���X����45�٣!�w���ۦ��-���۳��_�����u�̺���+�q�������	�M������K��5w�MV�!s"�"t%&�*�465�GKH�I$J�K�KNQ�Y4Z�[|^�^�e fjf�f�h0i�j3k�t�v�vxy���x�46��Ƒ�����۟h�B����ʨ*�I�e�Y������w��	�47#S$z$�$�*,�,%.r.�/�1�27�7�>5V7X�XoY�\�\^ _=bob�cEd1eh�p�~����ْќ'��u��ܤ.�����J���W�����Y�������^���g������������S�0�����A�> 
]y��K�O>Pr!sTx�xMz�z�}ځՌ��4�����K���S�����H���Z�]�~�٭��T���ǵ���������d�����!����� � t � � � ! �! �" m$ �$ 4, K- �. �. �0 :1 �1 /3 [5 .6 u9 �@ �A �D �F &H �I XQ 6s �u � z� � :� � �� y� ͍ Ԑ � �� ֔ Z� �� ;� �� 5� �� �� �� �� �� G� �� �� $� Y� y� ۪ k� 	� �� Q� �� �� `� � �� &� �� � ;� ^� � w� � �� �� �� � Q� R� �� k!	!B!�!�48!?!�!J!�!�!?!q!B!�!A !^ !� !� !�#!%!\&!'!['!�)!�)!�,!"-!�-!f.!�3!34!)9!�:!o<!d=!�@!pA!dB!�B!<C!iC!PD!�D!CF!G!�G!�G!�I!�J!&L!3S!NS!MT!�V!W!�X!wY!fZ!�[!+\!�\!�a!�a!Al!�l!�l!Rm!gp!�q!@r!�r!�r!w!Xz!�z!�{!�!�!9�!�!Y�!�!��!�!z�!/�!z�!�!��!�!k�!O�!6�!_�!N�!��!�!0�!��!̭!ï!ְ!��!P�!��!3�!�!��!��!��!��!�!�!`�!]�!W�!��!^�!��!>�!j�!�!�!��!Z�!��!�!3�!h�!��!"�"�"�"�"�"�""H"�""G"C%")"�,"L-"."�/"490"�3"%5"v5"M6"77"�9"}>"�>"�?"�G"�I"�L"�M"�M"N"�N"�N"�Q"�U"�m"�o"Ap"r"Gr"s"?y"�z";�"ϐ"ǒ"�"U�"��"m�"�"P�"��"r�"�"��"!�"��"��"'�"]�"��"e�"2�"��"{�"H�"~�"��"
�"a�"`�"�#�i#�n#'q#�r#�v#�w#ρ#�#.�#��#ҕ#L�#��#N�#Ġ#ܡ#é#��#"�#�#��#K�#��#�#X�#�#�#��#��#X�#��#(�#c�#��#=�#��#1�#�#��#:�#��#1�#6�#��##�#��#��#��#��#��#O�#��#�#��#��#�$�$$J$� $!$"$[$$J,$�-$.$�.$}/$�0$�2$d4$�5$q7$f8$�;$�<$�=$C?$�A$8B$�B$&D$WD$�E$`G$H$IH$�Q$�U$XW$�g$�h$Ej$-m$�m$o$�o$�o$�o$�q$sy$�y$�{$�{$F|$n�$��$�$F�$W�$��$z�$:%%�%�%G%{50%�%�%P%�%4%�%�%N%%�%/%�%�%�(%,%g.%�0%54%N4%�4%+5%s6%9%�9%k=%�=%�=%ZB%!D%E%�E%[H%�O%[P%�R%qW%�\%g^%gd%.e%�f%qg%]n%$r%tz%6|%��%�%�%L�%(�%��%S�%T�%�%��%��%A�%l�%U�%b�%�%�%��%��%��%��%��%��%:�%��%=�%+�%G�%��%@�%��%��%��%$�%��%��%�&&	&�&&%#&�#&�%&�'&�)&�,&-&�.&:&�:&;&�A&�J&eK&�K&�L&�M&�M&cV&W\&�\&�_&c&�h&[w&�x&~&�~&&O�&��&|�&؟&d�&E�&��&Χ&}�&1�&�&��&5�&�&!�&V�&��&��&	�&F�&W�&n�&Ͽ&4�&��&��&��&��&y�&��&�&�&��&=�&��&��&��&��&��&��&��&��&:�&��&��&^�&5�&o'�'�'�'�'�'�'�'@!'�"'�$'T''�''�@'�B'YF'I';K'O'tP'�Y'^h'�j'�l'�m'un'�o'�r'�s'�v'C�'�'%�'\�'E�'��''�'�'q�'�'L�'#�'?�'��'��'>�'��'��'o�'�'�'��'��'N�'�'V�'��'��'��'��'_�'��'y�'��'��'��'c�'��'\�'��'��'}�'��'��'L�'([(�((�(�(e51(� (�!(�"(�$(�$(�&(�'(�((.,(�,(�0(�1(3(5(L5(�9(L:(�;(q<(=(�=(�>(�@(B(�F(dJ(�J(�N(.O(fO((U(^Y(�Z(�Z(\(W`(i`(we(�f(g(Kn(�n(�n(uq(�q(�(�(;�(k�(؏(��(1�(_�(t�(��(w�(��(��(ô(�(V�(��({�(�(��(=�(�(��(��(�(+�(t)()s)252)�53)$
)�
)�))�)�)B)�)N)0#)N#)�#)S$)�$)�%)�%)*)V+)�-)�/)(0)�0)�3)�4)6)�<)�>)�?)^@)	A)�A)D)�D)�D)G)nM)OP)�P)Q)[Q)�Q)S)BS)CZ)se)�f)�g)�g)�l)�m)6o)es)t)�w)�x){)={)�{)	�)��)2�)\�)t�)��)-�)B�)��)��)�)��)��)��)q�)��)��)��)��)/�)��)X�)��)��)�)��)�)�)��):�)��)��)�*�*�*�*�*�*�*-	*+**C*�*.*�*�*�*�*�*�"*n$*�$*
%*�@*�X*g`*�`*Qd*"e*�e*ug*Pl*�n*ђ*/�*�*`�*��*�*��*+�*@�*L�*��*}�*��*��*��*54�*1�*Q�*i�*��*��*H�*��*D�*�*��*i�*��*P�*o�*D�*�*��*+�+:+�+_	+�	+�	+M55+�56+�57+?+�V+�Y+5Z+�\+D]+7_+Sb+xb+�t+u+�v+\x+�{+�}+f�+��+��+��+�+�+��+I�+%�+
�+L�+1�+��+��+ğ+��+C�+F�+��+i�+��+]�+��+��+��+��+j�+6�+��+��+R�+i�+.�+$�+z�+��+��+��+�+q�+��+t�+58�+6�+��+��+�+��+j�+��+C�+k�+��+s,-,�,,R59,�,Gl,Om,�m,�o,�s,Rv,�v,w,�,��,�,�,��,L�,�,�,�,�,��,h�,{�,��,�,J�,��,��,�,q�,�,"�,��,�,S�,}�,F�,��,��,�,��,��,�,V�,@�,��,Z�, �,v�,{�,�,��,v�,�-�-�-=-u--�-[?-�?-[@--B-WD-E-�J-�K-�L-QP-�Q-�S-IT-�U-]V-X-5Y-�^-�_-�a-ue-�e-�e-�h-Ǡ-��-��-�-2�-�-�-�-q�-��-��-U�-��-k�-k�-
�-X�-��-��-��-��-��-E�-��-s�-��-�-Y�-d�-��-�-��-W�-{�-3..�.v.�.�.�%.�P.�Q.�T.SU.4Y.f[.$\.^.{^.�^.x.r~.�.,�.��.+�.ף.�.I�.v�.��.�.�.��.m�.5�.n�.2�.V�.��.z�.��.n�.��.�.o/�/�/Q/2/�60/;/�/+/�/�+/�,/�-/�//�//�0/R2/3/A5/�8/z9/�:/M</7=/~=/UA/]K/FL/�N/�O/BQ/�Q/R/�T/�V/IY/p/9s/ms/�s//w/�y/�z/�z/�|/ �/d�/Q�/��/�/1�/��/f�/��/-�/X�/R�/��/b�/�/L�/��/��/~�/��/x�/	0�	0c610�0�0�!0B$0�%0
&0�+0�+0q,0�.0�10�20�40q<0=0v>0�>0@0�D0L0SL0Q0�U0,V0�\0�_0c0d0�e0Tf0�g0�g0