Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00122_00000_shuffled.ds.index69 linesDownload Raw Back to root
1l��|�<mXXV��9� �#W$�%�&�1�7#919�9y:�^�_�j�k�r�tGu}x�x�|�������M�t�H��h���ӊ�V������ҟ9���������������������<���M�W���2���������$�����������er��Z�i'�+$.�192�56}@�A�A�BSD~DeFnGhM�S�U3V�aed�tLu�u�vcρX��̉����ԎΏ���O�آ��˺ϻ|��@�H�������������M��x�
�C��T�����!���e���c�-�@���h���S�	���������G�w���X����0�9!>�?c@�@�@�A�A�BLE�G�HjI�IWgEhfj�jpl�l�l^q	r�st�u�v
w�x yFz*|�}���}�T��E���P�#�w����I������;���`�z��9���L����������`���+���0�`���]�,���j��������W��<k��!�!�#*%�'b)�,�/�718_8j:Q=�FKHK)LNU~!�0�G�����Ɛ�e����x�˰>�I����6���a��2�y	�3 Z�a�A��R�Yd&B&]'
=1>|>4?�@TD�ST�X�YP]cZc�c�g�j�l�tnu�|�}g��w�r�C�4��-�������$�=�5�!�W����������������E����������s�t���2���������
�8����=�'�i�l:m�r?vLw�z�z�{(|�|�|ۀЃ����̚����p�Ӫ�ɮ��"�ڱ��M������6�
�
Q!]�(�s��$�%�%8(�-.�0�0/5�5�56�6�:�<�CeE�F�HyI�Q�Q0[�\z]G_�_%b�c+dXfoq�x�z�|[}�u�7�d������E���t�j��������������^���o����0�C���0���q�{������]�i����P�����8	�	�9�10��"��11�_%�)�)w* ,�0'3�34829=bgqj[l�lrmd�R����q��M���O������$��
�f���L�J����:��N��2�'�*�s��������^���`�����G������{���>�J���i����&�z�!�!1*2�2�p�qC������߄�E���ć@�,���	�������b��@�D�������{�ɩ��������ô�۸w�u�ǽ5�����m���K�����$�>�i���_�����b�q�K�C��������c��.��� �q�����B������������T�W����6���=��-	3	�4	�=	�?	�@	4P	�Q	U	�U	�V	�Y	Z	[[	�]	:�	��	%�	6�	2�	n�	��	��	Q�	�	�	��	n�	��	C�	�	��	�	��	��	*�	V�	12�	`�	k�	^�	��	f�	��	�	�1314f15]16�17S	1819 20L21 2223924_25�26�27�28�29�30/31W%32a.33�.34"/35�/36g3371538,739�<40��41
�42��43��44��45��46u�47��48u�49�4�50i`��� �"�(�)�*�*�-=.]/x/v2:<f=�=z>�@�F:GAH2I
M�M�M{NZOiS$U�U4n�n|r?s�s}1~�$�!��������q�U�^������ݣ�*�Ӭ��W���O���B������]�����>�������q�����h�	R
�P��A&#)*{+�3�4R56�7�9�:eCm��o�ʏe�~�A�خ�m��������������������?��A��������b�{�����c51
�
L
�
C
z

�
&
�
!
K%
_'
q(
�0
�;
�<
�=
lH
�I
52N
cN
O
�Q
�R
S
�W
'X
�X
ț
��
�
��
�
j�
�
��
H�
Ų
��
r�
T�
��
��
��
��
ȼ
2�
��
{�
�
�
��
��
�
��
��
��
��
�	53���R :6 �FxTzUvW%[�\�l�l2m�m54pJs�s�vsy��
���V���/�%�ֵ ���й|���r�»*�ݽ3�L�}�����K�{�����d�����$�k�h����1xY>�'
�
�$��/Y�CD�{ �"D#�%�'+V+E3�3554�4�48:<�>l?sK=�H���1���)��J���$���U��������e�����Q��������2�����56O57�
k�������'DT��, 2,�,-�.�.�.�/�/�0U37A7`89M;�;<=�=>&?�B�EGkG#L�LzQ�S�ST�UWZ�i�i8vv�w<�К��^�(�C���$���ͳݳ$���Z�����#�1�����U�����[�7�I�Z���	�
OY�������P$�$x<>U?�?�B`C�FkG[I�J�JK�TDVPY_Z�[�\�]�]�_lf�foh�h58j|l�m�p7q>q�q�rv�v�wDx�z�z[|$~ƀ��G����x���	�t���o�߾x���#���}�v���;�m�X��	:;
�
���F"�#P&�'!)�),i,�.�1�2_3#4�5�B:ErEFFgI�M�PYQS�S7TCU�V�WX�X�^�d�ej!j,l �ο�����?�����B�&�D�����:�������g�����������>�X���E���u�������;�q��������������)��;	�Y9�gy��%�-B/�5F6�6@?59@>A]B�BCHSI�JvNtQR�RTcT�T`V�`�a�a�k�l�m�m�r<wV~������+�7���������ޛ������~���ذ?�Z�u�9���Ժ������.�r�L������O�i�������L���o�^�����H�:�f�WF������"�"Y#�#�$\7�7':�<4=S=�C*D�D]K�OKQER�R&S�SM]�]^%apamb�b�gi�m[q�s�sOt�wx�x�z�~�N�����}��r�r�60�n�	�U������N���\�����5�S�����61�#�3�\�G�����<�\8l�f�j�,&�9=�=�=u>�EMZP\�_a�a�c-e�e�frg�g�g�h6i�iY��������ş����C�٩����/���8���G���������x�������w���>����C�����G�������12�5�:+A�A�dIe|f5�$���W��������������s �&:'�,-�.�.h/�/Z0�1~2]5�5�6�819�;}<h>LC�FpJ�J�L+M�N�OP/P�W>X[d[}\H]�^u_sgh%iHk�n�r*t�w�wix�z9|x�V���f�"���l���^������{�k�A�,���P �Q R �R �S �V �W `X vZ �[ �\ �` �` Ca �a Dc e �e af h i Ri �i �k �k �l �l Jq �r Es Rt �t �v �w � �� � G� n� 5� {� 3� &� � ]� �� n� x� 1� � I� r� Z� �� �� �� E� � `� r� �� �� C� 0� �� � �� O� m� � �� � t� E!8!!�!6!�!"!�"!�#!�$!'!�*!|+!�<!=!B=!T>!1?!�@!nA!cC!�U!�X!�\!%`!�a!�b!c!d!�d!pf!ah!
j!)j!�m!\o!�o!�p!ʍ!��!S�!�!ۑ!x�!�!�!8�!�!p�!0�!��!�!I�!	�!��!5�!P�!�!E�!��!��!��!��!��!��!�!,�!��!��!q�!S�!�!�"p62"�63""�
"�"�""�""L"�$">&"�&"r'"�'"�("�."/"<0"�1"!2"�6"7"8"�9"w<"�="j>"@"�@"JA"�B"uC".F"�G"(w"�w"Iy"{"�}"I�"��"��"9�"g�"��"v�"��"�"ݟ"��"Q�"J�"�"2�"�"��"��"'�"��"+�"k�"/�"%#D#�#t#�#�#f#�#�#�#O#hQ#�Q#�\#l#�m#in#~s#y#yy#�#��#��#ڙ#��#��#�#l�#��#\�#��#��#X�#��#Ǻ#&�#Ǿ#�##�#��#��#��#L�#��#$�#��#%�#��#S�#��#�$$�$s$:$$v$�$w$i$�$$�$!$�#$$$�$$�-$z.$O/$*2$�5$X6$�8$�9$WC$D$RD$�H$�p$Rs$�s$�$w�$��$�$Ռ$B�$$�$��$�$��$�$��$�$Ţ$��$$�$��$��$�$��$<�$լ$��$Z�$ֻ$+�$��$��$��$��$+�$��$g�$��$!�$��$��$��$��$��$��$#�$d�$&�$��$��$��$8%�%%�%�%m%N%o!%Z#%1%%`%%�&%1'%�*%�+%�,%F/%�/%�4%�6%�7%[8%�=%Y>%`@%A%�A%�S%�T%V%[V%X%�X%a%c%�u%�}%��%$�%�%ф%��%h�%��%��%��%��%ъ%�%h�%9�%�%ϐ%j�%��%B�%��%_�%��%e�%��%ݢ%V�%��%y�%��%��%n�%��%�%��%��%t�%��%S�%�%��%�%d�%z�%��%o�%�%��%��%3�%;&�&�&�&�&�&P&y&�&�&64&�65&X&	&�&�&�&�&K&~&�!&e"&$&^%&�*&�*&F+&�S&T&�U&��&��&��&m�&��&�&�&�&��&ў&£&��&��&Ա&l�&p�&'�&��&��&��&��&s�&|�&��&�&>�&�&s�&��&�'m'�'6'66''�'�'@'''�'�'�('�*'q+'�+','b,'�,'�0'1'�2'3'3'4'u4'A5'�='?'jA',B'�E'�F' O'�R'S'�T'W'�W'�Z'�['�_'�c'Vd'zh'ej's'�t'ov'�x'�y'�z'�z'�'�'��'�'Є'�'��'|�'�'r�'s�'��'�'w�'2�'�'��'1�'��'��'��'�'(�'��'h�'��'�'��'��'��'P�'F�'�'��'^
(�(�(j'({'(�((�((�*(.(F.(�/(�/(2(~2(v6(�7(h8(�8(�<(=(?(�?(�@(�A(�B(�M(yN(�P(?T(�U(�W(�X(BY(�Y(Z(�f(
m(/m(n(s(ns(�t(�t(Uu(Z{(�{(u~((�(��(��(�(z�(ѝ(
�(D�(`�(��(��(�(��(�(_�(�(\�(6�(k�(��(J�(�(v�(��(��(��("�(��(q�(��(-�(�(��(v�(?�(��(��(��(2�(��(�)$)�))f)u)�)X)�)K)U)�)�)�)F")�")f%)�%)�&)+).)�1)�1)�2)4)[9)�u)�|)�)i�)y�)I�)��)S�)�)��)��)�)J�)[�)u�)B�)Ś)z�)��)�)ģ)��)�)��)��)<�)��)0�)?�)s�)��);�)��)1�)E�)��)��)��)��)I�)��)��)e�)��)o�)��)D�)d�)9�)��)��)>�)C�)��)��)��)�)+�)��)�)#*a*=*�****�*�*�*�*�*�*f*�*u*�"*�#*�#*�'*/(*�,*�/*C0*Y0*�5*�7*�B*�L*U*�V*	W*QW*�W*@X*�X*�*��* �*P�*M�*�*M�*��*��*+�*��*��*J�*��*��*��*��*��*F�*v�*��*n�*K�*��*`�*�*��*�*��*B�*��*F�*'�*4�*��*�+=+�+f+�+!	+�+�+A+�+-+�+*+�++-++-+�++D"+�#+!$+U3+�6+�7+�8+:+4@+z@+,G+|G+�G+�I+�Q+�Q+GR+�S+T+�V+2W+�W+v[+(\+�\+�\+�\+Pa+b+ld+�d+8e+Ug+�i+;j+�p+Wt+�t+nv+�y+�{+1|+�|+Ą+��+��+2�+Q�+��+��+��+B�+�+�+[�+ϔ+R�+�+2�+��+�!,0#,�%,/&,�',@(,�(,�(,C),�4,�4,�5,&7,�W,X,HX,�Z,z\,�],�`,d,e,�e,�g,�l,�l,�n,ho,�o,p,sq,At,�w,�w,(x,�x,Dy,�z,p},��,��,��,��,<�,��,��,��,��,��,��,Y�,�,=�,g�,X�,#�,��,C�,��,�,d�,��,$�,)�,��,��,+�,��,&�,�,��,��,�-�-U-�-�-=-�-�--�-E)-�o-�p-�w-�z-�}-�-��-"�-��-�-��-��-��-a�-�-�-s�-��-	�-��-s.�.,�.+�.��.�.��.!�.�.N�.��.��.��.
�.��.y�.�.��.c�.��.z�.�.��."�.��.��.r�.m�.R�.��.N�.9�.Z�.S�.��.j�.��.k�.��.��.{/s/�+/�3/�5/�6/�7/:8/�:/�>/�K/�P/-S/�X/<Z/]/�b/�i/�m/�n/�{/ |/�}/�/��/�/[�/#�/`�/�/
�/�/e�/��/��/�/8�/��/�/��/��/
�/n�/��/H�/��/f�/��/�/s�/��/��/�/�20EA0�A0�D0EF0�H0�J0�L0�O0eQ0�Q0�R0iV0YW0)[0�[0�]0�m0Mp0�p0q0�t0u0�z0*{0�|0��0��0[�0˅0��0��0M�0��07�0��0��0�0o�0��0[�0O�0��0@�01�0I�0w�0��02�0ֻ0Ѽ0��0�0��0��0�1�1�1[1�1*1�	1@1S1�1�1�1�>1G?17C1D1ZE1<F1�F1.G1�I1�K1�N1�Q1R1�R1�T1�]1Lc1�b2�c2u2dv2{2�2!�2%�2҈2��2q�2�2ό2H�2��267�2B�2�2V�2��2]�2�2�2�2��2)�2ҳ2��2��2��2�2�21�2�2z�2��2/�2��2��2h�2��2��2W�2/�2��2z�2l�2��2�2E�29�25�23x3�3�3�3�3�30	3.3�3�
3p(3�+3F43u43�53473�73�=3�@3A3eA3eD3�E3�E3�L38N31S3"T3�T3)U3�W3LX3�Z3�\3c]3�]3_3�_3ka3�b3�k3�k3�p3|s31�3Q�3̒3�3��3}�3��3��3�3��3�3T�3E�3�3��3�3X�3q�3G�3��3�3��3-�3�3K�3��3,�3��3M�3)�3��3�3�4o4�	4�684�4�"4j*4�*4�,4v-4x.424=74�P4UR4S4r[4z[4�[4�\40^42_4,`4�c4l4Il4�m4uq44r4�t4tw4�4=�4=�4��4C�4'�4F�4��4԰4��4t�4�4o�4�4��4�4[�4l�4��4�4p�4��4#�4�4P-5.5�.5:57=5�>5?5x@5B5�B5�C5+D5�D5�E5'T5
X5bZ5�[5%\5�\5*]5\^5Xd5h53h5�j5k5�r5vs5�t5�v5$�5u�5!�5�5��5ΐ5"�5�5ƚ5��5D�5�5ˢ5ߢ5�5!�5g�5#�5��5��5�5��5�5*�5*�5�5ɸ5ݺ5�5ؿ5��5��5=�5��5l�5��5+�5"�5��5?�5��5?�569�5�5��5a6Q6�6�6�6�6�6L6�6"!6`&6.6z/6�26f56�6676