Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00076_00000_shuffled.ds.index73 linesDownload Raw Back to root
1���>�vC��-�/#1j2�2�355�6�6�7�8�9l?@�@�BF&F�H�I�IrKOXO�O_Q�TV-V#ZP\~]�^�^b;bc�c�dSe�fgkgj
k�m�o�pq�q5rz�����N���6�>����C�o�����}���L���T��yi�
F-��a�*�,:-�-�0~1V2~4�6[7�7�8
:;;�;<�<�=�@�AQEF�b�bqm�nMo�rst:z�z0}t}~�~��_��,���z�Ǎ�������Μ�"�a��������$�	���J�L���й�j�7�G�������X�+�S���E�'�<�������i��I���	�2p]�.�!�"�#�$�&e(+E-�-�.�3J6{:�:\>t>�>)@[@�@�B C�K�L^R�ScU�U}VdWLmCl�l�m�nwo�q�yO|�}%�V�Ȑ+���Ւ�O���Ö"�&� �\���w�i���/�
��>�A���¯Ȳ\�5�S�d�X����������t�X�)���t���~�����<���n�����b�P���i��������3/T��x��\^ :"�(8)�)(*+�,.�/�0�1O=B>�>O5P�R�SET?U�VX>XYUY�YZ�Zq[-\k]�^%_�_�a_dhiJ�������-�������������������9���`�,������F���*��	�		�	� 		!	r&	D'	�'	�(	�(	�5	A:	,O	_	Hb	�d	�e	f	ؓ	Л	
�	ޠ	��	��	��	C�	��	j�	��	_�	'�	2�	��	��	��	��	4�	��	��	��	Q�	9�	��	��	%�	�	��	4�5p6�7�8D9+10p11^12�13�14,15.16�17618W#19%20S%21�122�123�824eG25:H26uH27�L28�O29BQ30-W31�W32�X33UY34�Y35[36�`37$a38�c39�d40f41ng42�g43@h44k45Rm46p47�s48A�49��50��51��52(�53+�54e�55z�56�57<�58�m��	^59���A�1��"7$�(0�07�7x8�;�<�=�bMc}cfi�jBmn)o�q�s]tf�������7�$�Z�s�{���ŧ�������Ԫ�عλ����2��������M�K���;���?��$����)������(�F���������b6x:�NeP�Sh�������R����k���՛���?�_�4�.�ɬ�����W�;�a��������������|���"�r��

�
�
v
�
�F
cG
bb
�b
�b
e
�e
�f
�g

h
�i
j
j
�j
�k
�l
�n
z~

�
�
9�
��
`�
�
��
�
�
7�
@�
��
��
7�
&�
��
c�
��
u�
�
��
�
��
��
�
���y
CM�V�mo��"O%�%�&Y9�9F;�=gA�BKE�F�QWTeW!d�dF�O�d�K�5����s�L�}������g�����~�-��� ��������3��k����o�@��60�`�2w�}��(�#n��!�()5.`.B/�1"2S3�4$;�;U=�@�@�AbB�CSD�EH�H�INLUef�fj�s�x2z�zP{�{�����[�������W�D�`�����P�`�����������4�L���������I���*���O�<���B���V�-�O�5��_%V�\# � 	'�?E@�A�A�B�C�DG�G$Q�R�S�T0VW�XZ�Z[�[]�]�]�]�dLfg|h�i�u%��ȃ%��������S�z����Ʀ������������}�B�������6�������/�O���i�u�6���3&6�7R8�9�LLP�RySmT�TGU�[]=e�fg�h:i�i�i'kWm*ntn+o�o�q�u!v�v�zJ�:�f�d����Ɛ��Ŗ&��������i�ټx�������Y��������������{&�'(1(%*�*6-�.�.�8�9�9E:w;�;R<@?@�@�FZG�GqHM�N�R�RST�TTU�Urefpf=i�j9k�k'm�o�o�z�ƒS����J��i�	�)�������5�4����w���}�����H�?���r���i��<�d������k�w�$�����J��Z���~�����v����?��61o
�
�Y�4S-�-|/[0�7�79�;"?�H�K^L�L:RV�V�XYvY�Z�[�^�^'j�j�k�|.}��N��Z��K�}���0�����(�s��J��������E���E�����������l�,���N�u�62�8�������v���������j�k	���.|m�S[�4 �!�"#I#Y$|%'m(�)Y,R.�1�:�:*\�bzc.fAi�kgm}oq4qoqIu-v�v�wcxy@y�ԅΆ)�t���ҌΏVMV63X\8^1_)`f��a�M�^�!{f���
��>�����%&�(�(�.1�4&6r6L9?:�:�>�A]BEC�E9F*G}HIUI%J�JgK�L�QOR�T�T[_Gbnd3g#h�i�k�ndpYy�}���{�΃a���%���v�)���B�64�u�R�J�����������/���d�������3�����g����D���Z�y�6�������U�����`W2�m�H�$&%T'<()5)�*�+�,/-v/�/�01�4X5F6|:�;d>?G?�C(P`R`k`�e1f�hlicjwj l�lDp�p�prKt�t+v.w�wy>y�ygz0�X�#���ޖ)��?�`�3��ê��]���j�y�u���B�����D�$��	�	�65�r����C/&�'/r?�?uAlBx���ˆe�������Z�G���/���A�ɵ�������.���>�Y����������������.�P�y�I�K���>��\�'������#
$>%@&f&�&�( ,K,�,6-�.?/\2.4687�76689R;ys�{k|�����@�?���̓�������R�B��ؖ^���R�����ϥ�M�E���<�������صI�Y������h����`�n��������P���C���������������2f3�4_9�97;@=�?
@p@�A�A!BC�C\E�F�F2xRx�|�|�~������������Z�֡���t�=�`�ԧȮEW,Y�b�b�cTe�ezh!n.p�p8q�q)r�v��&�3�����C���R������I�ݛ������֟����Q��������:�������x����S����������A�4�j4�4V?�@cB�BGD�DUGeH]LHNOCS�T�Z3aza�bc8i>m�oq_q�qQr�|�}π
�n���/��~���]���ޚ��8�����Ω��f�Z�v���\�(�¸�������=�`�p���������������������]���\�=�g����w�k���������t��IR&m�R_�%�(�(	-�/E7[8;�>�>VDEF[�d��c�ߍ��������4�T�Ȧ��W�c�$�ױ��}����������\�H�%����3���)��������V�C�z��0 G
 �
 K � � � l 6 � � " | ?  M V c � ! �) �9 �: T= > g? �C 9F 8I �N [O Q _ ?_ Db p �q �r E�![�!ʌ![�!��!]�!f�!~�!6�!ܕ!��!��!�!��!)�!��!��!��!߷!3�!Z�!A�!��!��!��!��!w�!��!��!O�!��!q�!�!F�!{�!)�!��!w�!�!��!��!n�!��!D"�"�"("�("F)"*"LG"�I"�J"�L"�N"P"�P"pQ"�R"M["l"n"�p"�r"�s"�u"�"��"�"�"��"�"5�",�"��"͘"ؘ"��")�"֚"�"ʛ"أ"¥"��"��"�"D�"5�"v�"E�"��"��"��"Y�"��"(�"8�"��"l�".�"a�"�"��"�"��"=�"_�"J�"�"m�"��"��"��"��"g�"�"v�"I#�#�#w#*(#�(#�)#�+#/,#-#�-#�.#o0#�0#11#�1#`9#�9#}:#�;#�C#4E#�F#iK#�O#qP#�P#�R#*S#�T#4V#\V#�Z#=\#�\#�c#bd#�e#f#+q#*s#^u#�v#�x#Oz#{#�|#u~#�~##�#��#�#�#k�#	�#s�#�#-�#�#��#U�#�#-�#L�#��#��#J�#��#e�#��#�#��#-�#��#��#��#��#��#��#l�#��#��#��#��#6�#��#1�#z�#�$f$�$�$�67$W$�$�$f$n $� $t!$�!$m$$�%$&$�)$v4$jD$E$�E$�F$H$�M$�M$�N$�S$�U$cV$�Y${Z$j[$�]$�^$-_$�`$5e$:i$qi$9j$�k$�p$=r$~r$�u$�w$yz$�}$�~$��$��$�$��$}�$��$�$ؒ$0�$ʖ$��$B�$n�$-�$f�$�$��$��$g�$��$��$��$-�$��$��$\�$�$��$��$m�$��$�$��$�$��$n�$��$1�$�$#�$��$�%�%l%%�%�%%�%p%�%�%�%�% %!!%�(%�+%y,%�,%V1%=2%�7%�8%L9%H%�H%SJ%�J%�J%vL% M%gO%�Q%�Q%W%�Y%R�%��%O�%y�%��%.�%�%�%Y�%,�%��%��%M�%��%+�%d�%��%��%��%��%P�%��%<�%p�%^�%��%/#&E%&�&&*&X+&�,&z.&�7&�9&>C&AF&EI&�K&�L&�M&�[&�^&�j&�j&�l&|~&�~&&�&��&�&m�&.�&s�&u�&Қ&�&~�&\�&?�&9�&�&5�&��&<�&/�&��&��&�&8�&A�&�&��&�&��&:�&w�&b�&��&��&��&��&��&q�&�&��&'�&V'�'�'�'O'�''�&'L''~''�('�.'/'r3'4'e4'�7'='>'F^'$a'Qj'Jk'�k'm'=p'�q's'ts'�w'y'�y'~'��'݁'*�'N�'f�'�'��'q�'!�'g�'ǔ'��'|�'Ǜ'�'+�'@�'��'�'��'X�'x�'��'h�'��'��'��'��'��'��'��'��'B�'7�'��'��'|�'��'b�'4�'��'n�'��'��'-�'�('(h(�(�(�(y(�(� (�!(�"(�#(<-(~-(�.(�0(�0(Y3(�4(�7(9(�@(GC(`C(�D(rF(dG(lJ(jL(�L("M(N(�O(>X(�X(AY(Z(IZ(4\(b`(cc(hd(�e(�e(��(C�(��(!�(�(=�(��(�(޻(��(ξ(Ͽ(��(1�(�(��(�(��(��(:�(_�(��(��(��(��(�(��(r�(��(\�(��(|)q)�)F)U)D68))�)l)�)�)�)�)�)>)V)�)�)�)M!)1)�6)�7)�8)f=)^>)e?)�@)�@)�A)B)�D)�G)�G)H)�H)J)�K)�K) M)�M)|R)�R)�T)�U)]Y)CZ)�a)Ib)/c)	e)q)�r)�s)�t)�x)y)�{)�})��)�)ˆ)c�)h�)z�)��)��)�)ȯ)�)��)��)X�)�)m�)��)ܽ)��)��)��)6�)��)#�)�)�)m�)��)w�)��)]�)��)��)B�)~�)��)�)��)�)B�)��)t�)��)�)��)z�)M�)��)]*f*�*|*�*�*F**�*�*k *	"*�"*�"*�%*y'*s(*h**�**q-*�-*L.*�@*nA*C*BD*�D*E*�F*@Y*�Y*.]*�]*�e*�g*^s*Pt*�*ށ*��*�*��*��*ݍ*��*��*��*69�*1�*ܥ*[�*��*��*�*j�*)�*L�*w�*��*�*[�*��*�*��*��*��*��*_�*��*U�*��*�*��*\�*#�*��*	�*7�*�*��*j�*W+U+�+�+�+�+�+@70+�+*
+M+�+�+�+*+�+f+�+�+�"+$&+g'+�1+H4+�4+&7+�E+,F+uF+�H+J+K+�O+�O+�P+�S+V+�V+�Z+[+]+�]+�]+�^+�c+jp+�q+H�+m�+ʃ+��+��+m�+�+�+'�+ԥ+U�+-�+��+��+R�+[�+λ+(�+{�+Y�+s�+��+j�+��+�+��+$�+��+�+��+��+�,�,k,�,:,H ,1,*I,�Q,0S,rX,�X,�i,Zj,Ok,nl,��,X�,��,��,��,��,N�,��,'�,��,�-G-�-�--_-�--'-4-�-E-c-�-�!-)"-�"-�#-^3-<6-�6-97-�9-4:-=@-^C-�C-�F-�H-hI-K-�K-�K-�O-�Q-gY-�Z-�[-�_-,`-�a-�f-|g-Uh-�j-�k-l-�l-	m-?m-�m-�n-zo-�q-.r-gr-�-�-k�-�-�-i�-��-V�-��-��-0�-��-%�-��-��-��-��-��-��-��-��-��-��-��-�-��-#�-��-��- �-��-��-+�-��-��-�.	.A	..�.�.�
./.�.�.J.O.>.�&.a*.�/.2.�5.67.S9.�9.�<.�=.�>.�?.@.P@.�N.�N.�m.q.�s.uu.Aw.y.F.V�.~�.�.��.
�.��.K�.71�.��.ܚ. �.�.�.C�.��.��.u�.�.!�.W�.��.��.G�.��.L�.��.?/�/d/6/N/�/w/�/�/,!/Y"/�$/0&/%'/�(/�)/1/�;/�</�>/.A/eB/�C/�F/�L/�1M�1��1��1ߒ1e�1"�1×13�1�1��1��1��1ў1	�1M�1J�1S�1t�1�1��1�1��1��1��1��1�1��1��1��19�1��1��1'�1��1i�1��1�1��1��1�1>�1��1�1D�1��1��1:�1�1&�1[�1��1��1�1��1��1��1�1��1+
2�
222k2�A2lC2�D2|E2�E2hI2�O2g`272a2�u2'v2Iv2�w2Px25|26}2�~2��2��2��2S�2��2'�2��2�2�2�2��2��2�2�2��2�2��21�2��2#�2��2��2i�2��2��2&�2i�2��2j�2�2��273�2l�2n�2��2��2s�2��2��2��2d�2g�2B�2��2�2�2��2m�2��2[�2l3�3�3N
3�
3�33�3�3$3�33�3;3�3?3�3�#3�#3$3F$3�$3�&3S.3�/3G3�H3BI3aJ3TL3�Y3ZZ3i^3�_3�_3t`3�e3�g3i3Mk3�l3�n3�n3�o3{p3>y3�z3${3�3i�3a�3P�3��3��3A�38�3 �3��3Z�3a�3v�3߼3a�3�3g�3��3��3��3�3f�3�3��3<�3��3$�3��3��30�3��34�3��3��3p�344�4�4<4�4�4�
4�4'4b44�4j4*4�4�4�4V4G4� 4�!4@#4�$4.%4�&4�+4I94�;4�;4J=4�>4�@4�A4<C4%D4GD4�D4lF4�I4�O4�\4#a4d4Dq4nr4�s4
u4>v4}4�}4@4�4R�4>�4��4]�4��4�4,�4l�4W�4��4U�4��4�4�4(�49�4i�4d�4�4i�4��4&�4��4�4