Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00068_00000_shuffled.ds.index86 linesDownload Raw Back to root
19Wr��	g0�156�7�8J>�AiG�GDJOK�Q�S�T2UhUyV�\�]�_�d6jUm�m�m�n!pHq�q�s�s�w+{�~�	�e����؇��k��5���?�����������(�Ǵn��R�����?�������-6�6B8�;�@oAiC�DnLMπ��'�t��0��'�D���������I���'�������������I���?��� ���30���>���
Uo�3�&v&�&�'�(�()c)�-H1�1w6�: ;&<gF|G�K�K�LnO�O�P�Q�Q�R>SJT~U�UIV�V�W�X�Z�_h`�e�ij�odpYq�s�vXwWx-{V~Ї����̜�����&�e��'�Z���������������F�e����)�����G�t���}�	���*�+�4=:�:�<=>�JK[K�O{Q�SX3X�XY�]�^(_�_�`�g������̐��5�y��9���Ҧ'���e��ڰ���q�;�f�2�^��v���0�J����2������]�������M������������'�u�6���/�~�	��K4�5��
r�#��"#H$�%�2�FfGH8H�Hgx�x�x�{�{E|�|���ܛڞ%�9�e�Ϥ���q�+����v������������0�O������f������Q���k���z���	;6Fbv���g�>��!�!�"�)�.�48H<v=�E/K#L�L�P�Q�Q[S�V�Y �����r����?���������8��ϧ�e���7�A�l����f���Q�Ƶ¶G�^����N���������=�v���J��
�T���b��"$#~#A$�$�$d%�%�(-y.&5�9J:�=�@B-FKQ�S�YZ!Z�Z{`Qd�d�e�f�gkYuv�v�x@ygz��(��}�I�4�7�E����ʧu�C���u�Ų�����r�3�m�;���H��-���L����������^���|���:�<JK�L�M3Q�T,UOV�X`Y�Y^�^�^9`�fui8jukwnqoq�u�v�w�x1y��'���
����������8��9A�10��11E�123�13��14n�152�16��17&�18��19��20%�21}�22Ʈ23�24��25س26��27&�28��29��30C�31 �32^�33ؽ34˾350�36�37��38��39��40a�41��42��43��44R�45w�46��471�48��49O�50%�51��52��53{�54��55��56��57��58�59w\����60��
xb	Sp>�>J?6APB�B+C�E:V�V6WXW^|a4c�j�kAl�l�n�}6~C�̓����щ,�����"�,���͛,�Ġ���[�
�ԩ��Z�����w�Ҵ�x����S�x�����>���*���j�=���������{���-���f�rvs�
_8tU�V�[�_=`%aQk:n�n|o�psv<v�vx@ykz�z*{�{Y}z}q~�~9����(�R����o���S�/�q����۠+�Ѹ������`�����m�����(�g�s��{�'
\
�	
\
�
�

�
x
�
�
�
;$
�$
%
�(
/+
o.
�.
[/
1
�1
#2
�4
�5
�5
?:
<
B
�C
�D
@E
�E
fG
�J
�K
`O
�P
.T
�T
NV
�X
P`
c
+d
�d
Ӕ
�
��
��
c�
ƛ
ٟ
��
!�
�
��
=�
��
��
o�
��
#�
`�
��
��
��
��
d�
q�
/�
�
�
`�
*�
�
��
q�
��
��
m�
��
a�
�
E�
2�?�\���n���0�1�7�7�;�=?�A�AUB�B�C�HEI<�̑~�U�������y��_�V���#���͢[�5�|�@�ݴ��N��������T��6���5��
,�!(&�&'��|���������G�?�������&�����������a�����	������D�S��1����M�z����*��Km; � �(�*�-,1O7"9�:�<�>UP�P�R�SX�XOYZ�Z[Z\�_�`�`�a@c�c�c^d�d�efp�����P��4�0�4�Č���61�P�x��]���2���<���\���q�d������$����������I�U���I�i���f����R�62/�+i�R~p"�#%�%&�&%'�*Y2�S�T�a�b(c�d�d�ejk8k�mn�n�o~q�s(t�zև�����s�װ�4���X��J�ʺ&��������I�����,��o�����G��H���e�?�g���"��g�a�r�63�64N����H!$)�*�.�1�3F4�4�;<�z�{�|�юd�*�ʛ��N���4�ܥ�����ѫ���{���	�͵���]�'�e���N����������\�����e���2�����a������%�K��)�#�$S&�&�)j-�.�.50v@�hvi�i�jMk�k�m9o]o{w�w}�}<~��Q���������l���������o�����G�����2�����65%f�O��O .!�!�!##�$�%&O&v(�*�-�.37�8�9,;�;>�>�C�E�F�JSL�NgZT]wk;o p�p�p9q�q�r�{w|<}�}s~�~�~�o��"�������9�,���º��������������v�����[��\��(�q���y�t�����F����������6���$���X�f��
V9�d4j8�8
9z9�;.=|=�=jE�F�G�G�HmK�K�LM�M,O�Z�jvl�l�y	z�{|���	�*���$���ĕQ�
�������X�����w������\�Q��n���((+r,�,-�-�-�.21�1�13a4�6�7�9�:|@1EoEAF)I|IJDJ66KSL�M�MnQ�Q�WjX�h�hgl�s�t�t�v�vmw|w�w&x�x�~��=�6�*����֎L����v�T�>��s���p�t){*�,�-�-�/�8�97:T@�@�K�UnV�[g\n^nVp�u[xQ}Le���x���h�`�ל�{��R�����Y67�68�	�G=!�%�()�)1+`ab(d�d�hMiFjl^l$m�m�ox�xDywy�{}%~��C�j��=�q����u������Ȫ�E���d������س��������G�T�~����(�	�	69�70�7��G��y�-:9�:4=�=W@uE^F�F�J[KL�LDN�P�Q�RT�T&VZV�W_X�X5\O]�^�^�`�b=ctd�i�j4k�ky^������������!����71�9�����p�����������e���Q�T�p���b���^72	d73��0�=gF����< �"#4#�%8&�&�6z>"?�?�@B�BiP�Q�Q�RU�U$VQW]Yzz8�@���:��ښ�������w�*���+�C�C�������.�l���!��!74�!Q�!��!p�!U�!��!}�!��!��!��!��!I�!Y�!��!��!x�!��!C�!�"H"�"�""�"�"m"X"�"�"K"�"0T"�T"�T"�Z"\"�\"�\"�_"�`"ug"Vh"�j"�l"rm"�n"/q"bq"gs"rt"�u"�w"\{"}"~"C�"��"ׅ"��"n�"��"�"��"�"��"s�"��">�"��"3�"K�"��"۵"w�"��"J�"��"'�"��"P�"e�"��"��"�"��"4�"��"O�"N�"��"x�"��"5�"Q3#�5#�7#�8#R9#�C#:D#J#a##f#of#�n#,o#�o#"s#u#w#J{#�{#�#R�#�#Ɍ#��#g�#�#$�#\�#��#0�#�#��#��#�#��#�#t�#��#��#�#C�#��#;�#z�#�#��#l�#u�#2�#ŷ#��#'�#��#V�#J�#@�#S�#��#
$$>$6$�$�$T$�$�$�$�$N$�'$6($�,$.$�.$r3$�5$67$�7$�7$�=$�=$OA$fF$oH$�J$�K$�M$.P$�Q$�R$<S$AU$�W$=X$Z$)b$�b$2c$�c$�e$-�$s�$ѵ$�$��$��$T�$��$��$��$��$z�$��$L�$�$@�$��$H�$�$��$�$��$y�$��$(�$9�$��$��$#�$��$��$75�$�9%g:%`=%h?%�C%�E%�E%�G%�J%�O%�W%�X%�`%?i%Hn%�o%�p%4q%sq%�t%�t%Qu%0y%��%��%�%��%��%�%��%3�%S�%�%2�%��%��%76�%7�%k�%%�%F�%��%��%ޟ%?�%ס%ݣ%¤%�%��%	�%��%�%L�%��%9�%�%U�%dz%��%��%��%��%�%Q�%��%��% �%��%�%��%(�%�%v�%b�%��%��%��%�%r�%�%��%��%��%77�%�%b�%#�%��%G�%W�%��%��%%�%��%�%s�%��%��%o�%!&�&\&C\&ca&b&Fc&�c&jf&1h&gi&�j&Xl&�l&�m&mn&Vu&;z&�}&p~&�~&�~&��&ׂ&9�&��&6�&h�&t�&�&9�&B�&�&4�&ޢ&�&k�&ޤ&K�&��&��&ۻ&I�&z�&	�&*�&��&�&G�&e�&8�&��&��&��&��&��&�&��&�&L�&��&c�&��&*�&l�&�&��&�&^�&��&�&�&��&K'q'i''K	'�	'�	'j78''�'z
'�'�'�'h'�''�'B'�'�'�'�'�&'�''�''�('%*'+'�0'P6'�7'�9':'�:'"<'�G'KH'2L'/Q'[Q'�T'�U'V'Z'^Z'�['\'A]'�g'�g'�l'�u'!v'~v'/w'�w'�w'�x'?z'<~'y�'ہ'��'�'�'V�'_�'��'�'m�'��'��'q�'��'�'��'v�'��'��'�'6�'ª'��'��'U�'0�'�'y�'��'��'��'��'��'�'^�'��'#�'|�'H�'q�'��'��'V�' �'��'X�'��'��'��'��'��'W�'��'y�'�'V(M(0(#(�(�(�(P(-(�(�((�"(�"(�#(�&(/)(�*(+(�+(t1(�=(�=(&>((?(Ub(�b(�d(<e(i(cn(�n(
q(Rs(>v(�v(Nw(�w(#x(�y(t�(�(ɋ(�((�(B�(Q�(��(��(�(բ(+�(��(#�(@�(ק(@�(��(<�(�(/�(�(��(
�(��(�(e�(a�(T�(s�(�(�(�(n�(R�(��(�(��(T�(��(��(%�(��(S�(��(p�(��(4�($)g)�	)�79)U)�)n)p$)�%)y&)/')))1)�3)Q4)�8)9)q9)u;)�<)$=)>>)�?)�@)�B){E)H)`I)�L);O)P)�Q)�S)�T)CU)�V)80W)�X)vY)Z)�[)\)d\)J^)�`)�b)�g)�h)Ki)�i),l)Sm)y)�y)�y)�z)�|)y})d~)�)e�)��)ł)ׇ)��)��)2�)��)m�)�)7�)ߖ)��)d�)�)3�)�)��)�)h�)��)4�)m�)�*g**r*�*�*h*�*�	*�81*;V*�X*Y*BY*[*�[*�\*�]*W^*�^*�^*#_*�a*�a*�*�*˪*O�*J�*�*�*��*�*��*��*��*��*�*��*&�*��*��**�*)�*��*2�*��*�*��*��*��*��*�*	�*C�*Q�*��*��*0+�+i+�+
82+�+S
+�++�+�+�++_}+�}+�+]�+��+҃+a�+�+��+ލ+�+:�+��+:�+*�+��+�+t�+��+�+��+��+#�+��+�+-�+�+��+C�+k�+��+��+�+��+�,�,83,,,,�,a,�,_,1,�,h ,�#,$,�&,L,�L,�L,\N,�N,�O,�Q,XY,=a,ga,bd,td,e,h,�k,�m,jq,A,�,��,C�,�,��,��,b�,a�,#�,7�,V�,̨,׫,.�,��,�,Y�,��,E�,��,�,��,�,(�,��,*�,v�,��,��,c�,��,t�,��,A�,��,��,��,��,��,p�,T-x-�-�-�--�-5-"-�-i-v-�-�-�-7-c--b-R-�-�-&-�-="-#-�0-�1-"3-\;-�<-�=-@@-�P-Q-S-�S-hT-2U-�Y-�Z-;\-�\-�_-1`-�b-4d-Kd-�e-�f-g-�j-Dk-�m-�p-�q-"u-lu-��-E�-��-��-�-y�-��-*�-Y�-r�-��-��-2�-��-��-��-��-��-��-�-3�-��-�.".�..f.>.�.�.�.#.h.@-.T5.
6.Q6.�<.=.�D.�G.N.�].^j.�j.?k.�k.�k.l.7l.kl.Om.(n.nq.�}.*�.�.V�.��.E�.�.4�.��.��._�.��.ǘ.a�.��.��.��.�.L�.��.��.��.7�.<�.��.��.�/�/$/�/� /�$/;%/�%/�*/�N/�T/�W/dX/�X/�Y/Z/�Z/��/��/��/�/��/D�/՛/{�/��/ܥ/A�/s�/�/X�/>�/ò/W�/t�/M�/��/��/�/84�/j�/��/��/�/��/�/��/��/l�/��/��/�/D�/��/��/y�/�/��/r�/��/s�/��/'�/K�/�/��/I�/%�/Z�/00H0�00
/010�60�60�90<0}<0�=0>0|>0�A0�B0uC0lD0DE0�N0�\0�_0^b0�b0c0{c0�c0Sx0�x00{0P}0�0��0C�0ϒ0��0Ɨ0��0*�0�0D�0�0��0^�0�00�0��0
�0G�0!�0��0�0�0ܿ0��0�0�0\�0��0u�0�0��0��0 �0^�0$�0O�0��0��0��0�1�11(
1	1�11c1u1�1�1�10 1!1�!1_U1�V1X1�X1�[1�\1�]1Sd1�f1�f1wh1 l1�l1Ro1q1)r1�r1�s1�s1�t1;{1�{1�|1}1z1�1��1��1��1y�1��1�1q�1ʑ1m�1ғ1��1�1`�1�1��1�1�1e�1ک1%�1�1��1��1t�1]�15�1��1��1�1J�1�1��1��1#�1U�1?22"2e2^285"2Y"2#2>#2�$2n%2q82pB2C2VD2E2�E2�F2�H2�I2�I2�K2�L2�N2HO2�O2Q24S2�T2�Y29Z2�e2��2$�2T�2��2~�2Ԡ2��2��2:�2�2u�2�2��2
�2V�2��2а2�2b�2��2]�2O�2��2�2�2��2��2��2=�2��22�2��2�3� 3�&3�&3'3�'3C*3�33L43�43�53"63�>3B3lD3͑3p�3�3Қ3�3@�3��3�3�3��3�3��3��3��3��3=�3p�3�3|�3��30�3��3��3�3��3��3��3��3,�3"�3V�3^�34�4^4�8644�4�4�4u4�4�4! 4� 4�#4�%4&4�(4 +4+4�.4Y14�24x54Y64�84�@4[C4�C4F4�G4�H4�K4pR4T4)V4^V4f4�f4g4fh4�i4Qm4�n4Yo4�|4e4=�47�4O�4љ4��4��4ɝ4k�4��4��4ã4��4�4}�4��4�55�55�85:58F5^F5�H5�H5�K5VL5xN5&U5�U5W5�Z5]5,e5ke5f5�f5�f5�i5j5vo5p5�q5~x5�x5/y5�z5