Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00018_00000_shuffled.ds.index112 linesDownload Raw Back to root
1?��*-r;-<{=�>�@�C�D?EYGzH�H{I�I@KM=ST�U�b	d�d�f1ghg�gzhi�n&o~o�osEu�w7yK|ǃS����������í��+�ܲ|�������#�������/�������j�O���A�N�v�-�o������������S
c����� �'5(J)�)�,�,�-�.^2?:]m^x^�^�`�`�`Xa#bxc�kl�l�m�o�opMp}qs�sCt�w�x�|�~
����������d�����H�Þ�3���ѥ�� �x�>������O�����Y�Z�˶	���r�=���:�����������k�%���`�������6�M�e���V����~����X�!k$*%�%(c)�)�)�/�/�23k456�67�8�8#:R>�G�m�n�s�y��Ʌ�����h���_�[�O��K���~�Ȩ]�˫έ+��۱c�����E���~�;�Z���H�����&���k���
�� kf��B�#�%�&'�'�(�0�1�2�4s5x6T:D�DIG8I�I�KTLP�Z�[�]�ade}ef/gng�k�n�o#pq�r�s+t5��j���+�����ߥ(����a��f�}�����)��������@�	�n�"��������M����%�����O����:q!t"q#Q$�$�&s*U,3h�sKt4v�x�x�y
z[z�zj|>~���܇�����;�������������*���q�s�2���8��P��%s� �#�$�%�/60�123�6	8E:W;�<f>�C3D�FvHJKDM�OHQ�XYj&jmrp�p'rsx�xxy�y�z����Z����]�ɞƟ��$�\��8�����q�q�ҹ_�ƻL�����<���-�Z�E�����^���������V�����F�
�������&V�� Y%�-r45�?�C�I�M�M�MO�Q�R&SAT4U�U�VX�`d�f�{�}�����c�އ�x�٨[���x�����q���������D��;��	��	x�	��	#�	��	��	��	�	��	�	:�	��	��	��	��	�	,�	�
2�384�5|#6G$7)8\)9C+10�+11LO12�R13uT14�T15U16�W17KX18FY19�\20X]21�]22�e23]q24!r25&t26.u27su28%v29�v30�w31xx32B{33�{34�35�36�37{�38��39V�40��41��42��43��44C�45��46��47��48��49y�50��51q�526�53e�54�55��56s�57��58L�59�60v�61��62"�63��64y�65h�66��67i�68��69��70��71��72}�73��74�75o�76��77m�78��79B�80U�81�82�83��84z�85��86m�87z�88��89��90��91��92�����
<Ca+7��&y+�+�-.�.`/�/q1�3f4�4%6�6<=pA	C�N�e�f݃(� �~�_��b�����2���,�����o���m�²S�*�δ����������V�-�����������������R����&�����O�����r����j�����H�B�3 � k!<"W#�#�+l-F.#/�1�12�48d8�8�9�9�;<'<�<�<�>�>�?^B�D'E�EI&JYK&M�N)Q�Q_WTZ(a�a8k93l94n"p0�ְ���V�������<���`�����Q�&�����i�2�����W
�
$
�
�
�
�
�
6
�
�

j
t
�
A

R
�;
<
\<
F
:I
�I
\K
RL
�L
�Q
NR
hR
`U
bV
�X
1Z
�\
s]
�^
X_
O`
�`
dg
Vh
i
\i
fk
�o
np
sq
�r
fx
�z
95{
��
�
�
6�
+�
��
�
��
5�
o�
إ
�
�
~�
+�
)�
��
��
!�
��
��
�
$�
��
�
c�
��
��
S�
s�
)�
�
��
���W�Yx$t$�$�?�@�@yD�D�E�F5z�z�u�Z�a��o���������w�����Ǩ��"�96��W�1�W���#�����e�d��������.�e�s�,
-�-�/�0�1�1z9:<_<^=<?gXG],h6hbi�i�p4�`�a�ӌx�7���97�����;����������ɵԶr��v�$�����j���_�H���d������g�����w�������#�k*�	O	�
(�{D�B!"�#�#�)W*,�,�012�23$5�8�9O;�;�;>?A<B�B�CH�HI�I�J�KkL�T�V;Y�]�`�`�m0o#r�r�s����T���Y�&���C�–g�?�����x������=��˦��Ω�����c��1�ɻa�T�����B�R�������l���K��������O��{�J�	���x�+�D � � ))v)$+1n1e7�7�8J9;�<=^E7H�I�L4N�TW@W�W�Y�[98ceg�g�g�i�p
r�s�u�w�{|�}Y~�~�!�~�<���{�m��ˑ/�!�6�I����������ݨk�>���ѭi�ڴG�q�y����
�o���;�<�DlJwKhL;P)qPqnr�xyay0}���h�֏X�?��C�l�m�ҜT�`���ʩ����#�ϱJ����d�5r�� !�!a"r&�*
+@,M-�-3.>1�1779:O;<;=�?w@�dPj�j�k�l�lnolpؒЕ����:����d���>���x����.58�8=9�<�J*LO�_�`�`d�d{m�p�p�s�s;t�z��ň��N�������w�����f���*��~���#�D�d��R�¼�[�b���1���3�[�4�������8���:�+z�|�Ё��������ڋ�G�e�����U����X�آ��o��a���N����q� �����$�z�r���"��������������%��X�'Q(+*>+,�6�8#:@;�;B=@�A-BXGCH�H�H�IK0L�L�M�N�O S*Y�[�^�_�_c�c�c�c�kzl�m�m�t�t�u�v�xwz�z6{}|�|����I���p�S� �����f���=�������������K��������m�!W"
'�'C.�4�5G���`���k����������*�����B�����!����599�100�����%�%�%7'�'+�3�<h>a?�?3@A�K]OSSzST8T�TWkW$XcY�Y+Z*[@lgp�pas�s�s@t~t�xy�y������ �׏�����Ǖ�4�������W�ޣ'�*�ӥ�����I���v���0��}�������S�M�"���w����(�)D5q5�D�E3H?JAK�M�NO�U7WvWOY�Zy\�`A�y�$���/�*�ݩ�]�o��	�r�m�Ժ101�S�s�d�:�������O���������������������<����������.����n���������Y�a�D���k�����E�P}
C�ER�0N"�"�#%h%102&K&"15<�҅L���̎u��ؐ̑X�ɘϠ�~�e��)�����{�1�W���������e���*�i�#�����%���0���U���7���R�<�X����'�|��K��:��103z�
R��:��!�!	#{.�/_4>7p;t>[@}A�B1ClF�HK:K�L�L�M�O^Q*U�ZR[�^Z`q�r�rs�vXzfz {���ϓٗp�$��O�$�]���!����P���-������.�O������������w������~���U�����5���K�|�T�X������(���H���������i ] r � � t � x104  � � S
 T � h � � �  U! �" $ ( �, �, �9 �B �D G �I �K �M QP vU Z *[ V] �g �h k �� �� >� �� �� %� �!q!�!7!8!M!�!�!�!�.!�0!b6!o8!�9!:!�:!$>!�@!�A!�C!�E!�G!�K!�L!-M!-N!|P!�P!�Q!U!�V!tX!�Y!�Y!o^!G`!Fj!�k!:l!Ut!gu!�u!Kv!!R�!
�!��!��!J�!Շ!��!E�!I�!1�!�!�!��!¤!��!��!�!��!�!g�!Y"D"�"�
"�
"&"�"t""�"V"�"�"�#"("�("*"�*"E,"�/"L5"�6"	7"�8"�="�=">"�?"RA"�F"�G"(s"ys"<t"�u"�v",y"Ty"%{"�}""�"C�"E�"k�"؈"��"	�"1�"��"��"�"P�"�"��"��"W�"A�"��"�"s�"��"��"��"Q�"��"��"��"��"��")�"#~#[#D
#q#.#n##[#�#�#>#�>#�>#3B#�B#G#CL#�L#�M#
N#�N#nR#�S#�U#�Y#�g#�h#�j#�j#{o#�o#�o#_p#�p#�t#Av#~v#�v#�w#�z#'}#B}#�}#^�#u�#Y�#T�#�#ގ#>�#��#e�#f�#��#��#105�#?�#�#��#�#;�#��#V�#ӧ#d�#U�#ή#<�#@�#?�#��#o�#��#o�#��#��#|�#R�#I�#��#T�#!�#�$�$D$�$l$�$�$�$�$o"$\)$�)$f/$�1$�2$�6$�7$�:$�;$O<$?$S?$F@$KN$�N$O$IP$U$zU$_V$^$`$�b$�r$�s$��$��$j�$͈$��${�$��$�$�$&�$�$��${�$�$�$�$�$��$��$��$��$��$��$��$��$1�$a�$��$��$��$F�$��$(�$��$��$�$y�$�$`�$ %*%�%%�%?%r%�%�%G%%�%�%�%�%6 %w!%�$%�'%6(%�(%�)%	+%.+%|+%&-%�3%�3%�4%7%^8%C9%t:%�%�%o�%h�%��%D�%��%��%\�%��%W�%7�%3�%��%��%.�%�%��%�%5�%1�%��%��%��%�%&�&&�&�&Y&Q&�&�&	&�&E$&�%&&&k'&�+&,&�,&.&c.&�3&5&
6&�6&�8&;9&`9&�:&��&%�&m�&{�&��&2�&^�&O�&��&N�&b�&��&)�&��&��&��&��&V�&��&L�&?'�'Q!'!'�!'&'�&','.'&/'�1'�3'W5'i7'=:'�:'E'H'�]'�]'r^'X�'Y�'��'z�'��'�'�'>�'Ӝ'��'��'ʡ'�'��'S�'��'�'g�'�'��'��'3�'G�'��',�'��'|�'��'��')�'��'F�'��'O�'��'q�'[�'G�'s�''�'��'��'��'��'q�'�'��'��'d�'��'@�'�(o( 	()106(�107(�(�
(�(V(g(
(�(�(108(E(�((E(�(b#(�#(�%(�)(�+(/(U/(0(|<(�<(�?(hA(�A(=B(�C('P(-U(�V(ZW([(�[(J^(�^(+`(�f(�h(ai(�i(;k(�p($q(Hs(ss(�t(�u(�v(!x(]y(�(X�(%�(�(��(��(f�(��(#�(��(��(�(y�(f�(��(G�(ܰ(1�(ڲ(��(H�(��(��(x�(�(k�(�(#�(��(��(s�(��(�(A�(��(��(l�(��(�(,�(Q�(?�(�(9�(��(`�(��(S�(��(��(��(��(��(:�()�)�)Q)�)�109))�)�)?)s)�)�)�)�)	)e)�)�)�),')m')7()*)8+).)E6)�6)�7)�7)�7)D8)�9)a<)�<)�B)�U)�^)�c)�d)Ge)ds)4u)�{)�|)})z})�})�})e)ށ)��)V�)0�)*�)5�)�)��)l�)��)R�)��)�)��)2�)i�)��)�)Ӳ)��)�)W�)I�)&�))�)ټ)�)z�)1�)*�)r�)��)��)W�)��)��)��)��)��)�)\�)��)��)�)��)��),�)��)�)Q�)��)�)��)��)��)��)7*�*�*E*@*�*@**#*�**�*�*e*�*@*�*�*Q *("*�2*�G*BH*�H*!s*�v*(z*�z*{*z{*�{*~|*�*>�*��*I�*�*��*��*��*}�*c�*9�*<�*?�*��*+�*̡*3�*��*x�*�*j�*�*��*F�*ų*^�*{�*��*��*M�*��*��*��*]�*��*110�*i�*�*n�*`�*��*��*��*��*��*(�*�*z�*��*��*��*>�*��*��*V�*|�*N�*��*��*~�*y�*`+(+�++�++t+E
+q +�!+.(+*)+�/+2+�2+�3+^=+�>+�R+�S+7T+WT+�T+}Z+�Z+$[+�\+�`+4b+�c+6e+l+V�+��+&�+\�+��+�,J,|,5,,	,�	,111,�112,`,�,�,#,d,@,�,9,",T,�,T,t0,J5,7,�8,79,�:,�;,�<,�=,�=,*A,>D,
E,�E,�I,pM,�N,zO,cP,|S,KW,wZ,[,�[,�a,5b,�h,:i,j,�j,�k,tq,ku,v,�v,�z,�|,�,��,8�,�,+�,N�,��,ۈ,��,��,̋,H�,Ǎ,��,M�,�,o�,�,��,ߖ,-�,��,�,Μ,��,�,�,�,`�,��,q�,�,r�,��,��,��,��,s�,��,�,��,N�,�-q -�!-�"-t%-�&-)-*-�+-�,-.-F/-�0-�3-6-v7-�7-d8-�9-#:-�D-�E-G-H-�H-6K-	L-�L-�N-I\-<c-�d-�d-Fg-h-�i-o-ky-�y-�{-R|-h�-��-T�-��-"�-��-��-��-�-|�-��-ޯ-$�-��-��-ش-'�-�-�-D�-�-N�-3�-��-S�-�-m�-��-��-��-'�-��-@�-"�-��-��-D�-��-��-��-��-�-��-��-��-��-l�-�b.�d.*e.g.�i.�x.1y.@y.,.�.�.��.��.��.H�.��.�.7�.i�.P�.�.{�.A�.��.�.S�.ҳ.^�.T�.Զ.f�.G�.l�.��.r�.q�.��.��.(�.��.a�.��.�.��.��..�.Y�.��.�.��.@�.��.��.�.`�.�/�	/?/h/�/�/C/f/�!/#/#�/��//�/�/e�/�/�/��/#�/��/o�/�/٫/ò/V�/S�/+�/��/�/ҿ/B�/_�/��/��/:�/��/
�/��/��/a�/��/Z�/C�/P�/r�/��/�/��/+�/A�/��/��/��/1�/|�/|0�0s0�0�0y0�!0�#0pF0�M0�a0�b0�b0*f0�i0�k0+l0�l0[m0�m0�m0�n0,p0�p0��0؈0)�0g�0/�0;�0I�0��0�0��0*�0��0�0�0�0h�0�0x�0l�0r�0��0��0��0��0��0��0s�0��0�0\�0��0K�0%�0��0��0�1�1�1u1w1$1,1?1�1�1�11�"1$1r$1�%1&1h&1'1�'1�(1�*1k,1i.1�1:�1�1�1�1�1š1��1'�1��1i�1�1��1�1R�1��1��1&�12�1d�15�1u�16�1��1<�10�1�1#�1`�1�1�13�1��1N�1��1��1��1��1K�1�1��1�1a�1'�1��1S�1&�1��1K�1��1q�1L�1��1V�1��1��1A2