Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00086_00000_shuffled.ds.index72 linesDownload Raw Back to root
1 @"�#02�3�3�56�6d87=�=�=s{�{n|+}�}|~�~V,�ƅh�0���N�w��2�A�����֨����Ī��̫n���<�R�u�]���������e���������������B���ly��2����HyO�U~X7Y�\^�_	`�`Va�c�fP��4�T����כ��V�9������H�������q�i�	���O��G���|�����������������'�C�
3��-��7!�"�#�#�$(�)�,@-F4D8�:�<s>�?�A�AeFAG�H@J�LO/Q�Q R\]ro�r)tptHu�x;y�y�z�z�{�}2���-�_�-�e������c�ʞ�����P�E�K���G�S���8�����������!�9�����u����D���P�P�	o	�	<'���A�"E#[#�#$'�'�*&+x/.2�2�4�566V8�89�9f:uLGN�P�QiR�SET�V�Z�[�[�\^P^^�_��E�-�Z���h���E����>�I�-���'�f�	�Y���]��[���������{��4���3�W��Q]�����$A)�)�I�L/M�MBN�N�O�`za�ilypdrs�s�tv�z|}^~��ށ2�Å��Жc����"��q�����W�Ȧ˧������ݵ��ƹX��E���_���a�wpXtu������������I������X�bFnF�G]HHI�K�K�LfN@OhOgWzX�YZZ�h|i�k�k�m��̓ֈ^���בS�E���?�Y�;�M�j�~�z��í �ͮ��y������+�y�����@�������%�p	� 	�*	�+	�-	:.	�9	�;	�<	=	>	?	�@	�@	XE	�E	�G	�H	�L	~N	O	�O	XP	CV	qX	�[	�]	n^		_	h	/h	�i	ds	�s	hy	E|	�}	j	Ղ	��	߆	��	i�	�	��	��	I�	�*3&.4�5566�77�78Q9�T10�U117Y12�b13�c14Dd15�d16%t17�t18�u19�v20w21^w22<z23�z24�z25o{26
|27�}28�}29Q~30��31�32т33m�34�35b�36��37H�38��39R�40��41�42��43+�44��45^�46��47]�48}�49�N
�O
�Y
�Z
�[
�\
$]
r]
�]
�]
�^
�a
�a
�g
sj
_l
m
�m
�o
�o
�q
r
u
v
�y
H}
B�
��
�
��
\�
Η
j�
e�
z�
��
�
�
�
��
"�
2�
U�
Y�
��
z�
�
X�
��
Ш
�
v�
��
D�
��
��
��
��
�
l�
f�
]�
��
��
��
>�
*�
G�
��
w�
!�
P�
��
��
b�
��
`�
��
��
��
����,��x�F9 y � $50%�%&�&�)�*v,�.�.�.2�4�49j<�<�=?�O�P�QRFT-WYZ5Z�Z_Z_�_`�bc�d�e�k�pnrs�tJuYwvxKy(���v���_���7����h�P�f�����51�����իQ��������ٵ(�2���J�n�b�����(��������������
�I�����&�C���'�?�D�����W������	��#4&�'�U>X*[9d�d�e�f�fnhiGi+j52l7n�n�s�t�u�w�~C����χ����-��~��>�&�1���]���G�N�h���ӷ`�@�Y���|�u���o���c�������`����������H�pu��H	v46�67�:�;�<�H��:���������>�I�*�����r�������G�q�
�����gU���V%�%j(T/v0�5w67N8�X^Y�Z\M\_�b�c�e�ep�q�r�u�w�wzx�x y�y�y;{�{��ӌi�n���1�ڛ��+����%�YU#�#'�)r+�+r,�,�,J.�3�7�8u:<;�<'=�=>v>4B�E9FMG�G�JxKO�P|QRS�S�V^F^]^/clcwe�e�f�g�hri�k�no�o�o�v53y�{�~s���#���:���ԔȖ2�ޚ�S��3������ú�Ľ����Q�����5��X���B����������.�
u*g(���a"�"�$�$,g,�.�0X1�9�;�@�@pB�CD�DdM�l�m[npjq�rgs�sPv�v-w�x�x�x���}�;�ǧ����M�`���;�O����~���C��QU]��W	6545���[ � 1!�&1(*U+G,�-//�<�D�F=G�G�H8I�O�Zq^�^�amo	r�t\v�v<x�y�z�����9�����!��Ս&������<�F�m�?�0��(�����e�y�}�������������������Z�h�����D���h���c�1i0=1�2�355:=;�?AIJ�K�OS.WxW[�\_�_�b�cfqf�m�o�o5pvpfq|x8���U����c����Q�����J��E���ˑ:�Ʈ����ư��س���5���H���i��)����k��#�#�%!&�)%+v.1�4�7�89A9:�;<#=�E�I�KJN�O@P�P�Q)RvVWX�X�X�Z}[Sj�k�k�r�s�t;x�x\yQz��$��G�h�ă������kpsJs�uw�w$~�~b�΀���L���f�g�ɑ�m���^���������d�����O�����56���^������ ��I�j�o���2t	u�uv'|��؃>�S�ب����D�������<�j�>�������������C����0�������Y�u%�%+g9�?DB�BI�IJ_;_�_�k�lnUn�n�o�r<s�u�v%y�yAz����ȇ����Q�����5� ���M�	0�D�>2���$b'.({(U-�5q6}?kAOB�BcQ�Q@T�|ր|��_��������;���������L�"������������
�'���0�������o���	�x������,���w���_�.�.����W^Y�jGk�l�m�mr`����P�ً��̙���;�q�ۢ���V�̸	�x�:�y���e�P�w������C�������s���M���;�����������W�;����7��g�D�@�wm#<$�$%7%x3�3:�;�>�@C3G$I>JcK�L�N,OR�R�S�\+]�a�a�{�}k�/�����M���K���֕H���;�И4���U�����F�ע�������;���B�4����&�̸��j�׽����H���$�����V��357�S
?��Q�1&�&�(�+P,�-X.%/�/u6�9�<�@�DkE�G�H�Q�T�VvW�W^X�XaY�Z�[i\�\�\�]�ab^hVi�iZjl}n�p�w���o����������#�.�3�p����š��*��J�v�:�|�g�U�����	������9�������*�l�u���������p����������	�}��<�M�"�1�����R�8�����A�E�
k���a��M��Qj�58$�$�%u&�'6+D,k,�,M-�0K1�1�1DG�IEO�_.`�b�c�cRdt u�}*~0���׉̋Z��`��
����}�>��e�(�.	U&�'�(w,�.�.:o>�E�F�H�M�N5OaO=\�]W^_a�a�b�d�e�fop�pFq]sKv$wzy�}ɀ������a�/����8�ê\�����$�a����ȱB�����8�����~���|����P���G�����<( H6 d6 w �w z � O� �� J� X� � �� � ֘ B� �� %� �� '� -� �� 7� 9� � g� u� S� � 2� (� �!�!�!�	!!j!�!�!�!�!�!,!�!�!#!u$!&!�'!�)!A*!�+!�,!�0!�1!5!X6!_9!�;!o=!�=!�>!_�"��"��"�#�59#)#�##x#�#-#{#�#j#�##�#�#�#0#y#�#[#�#'#X(#/#�/#P0#A6#�6#�7#z9#�9#�?#j@#fA#�C#%D#�H#�I#�J#K#�L#QV#�V#fW#�^#e#�e#�e#	w#�w#�x#�{#|#O|#�#|�#ޗ#��#��#�#��#W�#��#��#�#4�#�#��#�#7�#ެ#:�#��#O�#�#��#��#��#��#��#g�#��#<�#Y�#��#?�#�$C$�60$$u
$	$$�$V$2$+$&/$[/$�0$O2$�2$	3$�7$k;$�>$�@$2B$�B$�B$.C$cF$�L$�N$�Q$�S$�T$�b$�b$�g$/h$kh$�h$�h$j$7l$Zl$�u$Á$��$
�$I�$x�$��$߉$؎$�$�$ڑ$Y�$�$ޕ$~�$��$�$��$X�$g�$��$u�$ˤ$��$�$�$ǧ$��$�$��$��$ؿ$ �$��$��$�$~�$�$��$��$��$�$,V%SV%�V%W%jW%X%�X%Y%7[%:\%�\%�]%�^%`%�`%�e%)g%�h%4i%�j%�l%~o%�w%cx%gy%�z%<{%�{%��%�%��%��%��%3�%\�%�%\�%ǭ%&�%	�%��%��%k�%��%"�%��%+�%��%��%��%��%�%��%[�%��%��%��%��%�%C�%�	&�&�
&�&X&�&_(&"*&	-&�-&.&�0&�2&8&-9&4<&>&�@&�A&TB&UD&�D&cE&F&}F&H&J&+J&�J&�O&Q&iQ&�R&U&�V&�Z&�[&�]&�_&�d&�d&�e&f&�u&�u&x&�x&�{&��(I�(	�(�(��(s>)M)wO)Q)�Q)�R)�R)1S)NS)�S)%W)GX)e)�n)4u)�u)(w)�w)�y)B�)�)Y�)�)��)~�),�)˙)R�)~�)��)W�)+�)��)61�)¸)��)��)��)��)��)��) �)�)��)m�)9�)&�)@�)�)�)��)2�)f�)��)�)E�)��)Q�)��)��)u�)��)��)9�)��)��)��)*P*�*�+*0*�0*,1*X2*O3*l4*�9*B:*R;*�;*&<*�>*LI*S*�S*gT*	V*<V*vY*[*�\*�]*4^*�^*�_*,b*c*d*ue*�e*62f*+g*�g*Gh*2i*�j*�k*�k*�k*�l*�*�*ښ*��*�*4�*a�*`�*��*�*63�*|�*64�*d�*��*o�*��*B�*O�*��*��*�*��*1�*�*��*;�*��*��*	�*��*�*U+�+k65+c
++�+$+�+h+�+�+�+�"+$+�&+)+�)+�)+�1+K2+t4+!6+@9+Q<+i<+`=+�=+?+ZB+�B+!I+�J+�K+�L+_M+�M+N+�N+�N+9O+�O+^P+&T+�h+�i+�i+<k+Gq+>r+~r+�s+�+Վ+�+(�+ܖ+�+��+z�+{�+�+h�+��+S�+{�+��+�+��+��+'�+��+�+��+��+��+�9,�9,w;,�E,�E,�E,�G,�G,�K,xL,�O,�O,rR,FS,�[,~_,�_,(`,@c,6d,~g,!p,yr,�s,Cu,"x,�z,�{,�},��,��,ˆ,>�,0�,*�,��,Q�,��,U�,��,!�,T�,�,�,G�,��,2�,˨,q�,��,��,b�,a�,��,u�,��,�,��,s�,3�,��,?�,^�,��,Z�,G�,��,��,�,��,��,s�,��,��,��,��,��,��,��,T�,I�,�,��,66�,��,E�,��,��,o�,��,L�,��,��,��,��,��,R�,%�,��,�-�- -G-J-H-�-�-�#-�,-!--8/-C-�E-�E-F-TF-uH-q-kq-~u-��-�-[�-��-/�-χ-�-B�-��-�-��-��-׌-�-z�-ڑ-[�-b�-|�-v�-��-ě-{�-E�-e�-�-��-�-D�-�-:�-��-L�-(�-*�-��-�-�-E�-J�-��-0�-��-��-P�-��-�-4.�..F.�.?.�.T.�.�.- .>!.s!.�!.$.�-.�-.�;.]<.�<.]F.�G.+M.uN.�O.�P.�Q.~\.Bm.�m.�o.op.�p.%q.or.Zs..z.`z.Q.��.�.j�.g�.��.�.W�.��.�.q�.��.$�.�.>�.K�.��.�.e�.��.��.��.��.��.��.�.��.��.��.P�.g�.��.��.��.(�.��.E/�/�/�/o/j//�N/1Q/�Q/}R/�R/�S/�a/�a/�b/�d/,e/:g/�g/�h/�j/Ep/�p/4x/�y/!z/�{/_|/�~/��/�/��/�/_�/b�/&�/[�/��/�/_�/7�/��/��/��/ֳ/V�/��/e�/��/յ/�/��/�/Ǻ/Ѽ/ �/_�/�/^�/��/��/��/��/��/��//�/�M0N0d0i0�i0Pl0ey0�y0�~0�~0�0؀0�03�0c�0e�02�0��0�0�0ʙ0m�0G�0��0��0ݡ0�0Ϧ0@�0x�0ʪ0M�0"�0|�0��0v�0��0��0&�0��0��0�0�0"�08�0��0�0��0�0��0a=1~>1Q?1�?1+@1�A1�A1�G1�J1�J1�L1�L1o�1��1��1672l2�!2�&2'2�(2`+2=;2�=2�>2�@2�F2�G2�I22M2�M24P2�P2�Q2/U2�X2�b268c2/c2Ad2�e2�y2�z2�|2�2t�2�2��2,�2�2�2��2ϵ2�2�2��2��2��2�2��2<�27�20�2��2��2��2��2��2h�2��2S�2c&3�&3f'3)3~*3R+3k,303�0363N3!O3`P3R3V3SV3W39W3�W3[^3/_3F`3�b3�b3�c3�e3�f3]k3'q3�t3�x3�z3�{3Y|3�}3�3��3��3ρ3ƃ3n�3��3�3�3۪3v�3_�38�3F�3f�3��3Q�3@�3/�3��3v�3��3u�3[�3��3��3��3�3��3R�3��3��3�3�3[�3��36�3��33�3��3��3��3�4�44e4�4�41	4�	4694�4G4q4{4�4F4�4a!4�-4S04x04=14�14�24�44�44�54�74;94=:4�:43@4A4�A4B4�C4�C4�E4�G4�G4�G4HH4�I4O4?O4�O4LR4�R4V4/X4�Z4�[4�_4ja4�b4�c4�c4)f4�g4�i4mj4�j4�l4�m4�q40r4�t4�v4�x4{4�|4�|4�~4�~4�4�4�4�4��4��4��4�4ֈ4j�4!�4��4T�4+�4��4�4�4��4˗4��4��4��4�4~�4Ѡ4v�4x�4��4.�4ϥ4�5/�5l�5��5R�5��5��5`�5��5&�57�5��5T�5��5?6�6�6�6�706�6�66�/6o26�26�46(5666�86q;61E6F6�H6
I6�I6&K6�M6�O6:P6yQ6XR6�R6�p6�s6{6�{6��6|�6ݠ6=�6�6{�6��6R�6j�6S�6��6��6��6��6]�6�6�6%�6��69�6��6E�6��6I�6��6p�6L�6��6~�6��6F�6@�6��6�6��6��6��6��6��6��6��6�7b7�7J747J7�7717�727�7�
7i7�7�7p7�7z7�7[7(7{7a7#7�#73*7F.7�.7�/707g07�07�17A47�47e57�57k67879@7	E7TE7�f7Di7Bj7>k7�m7$n7�n7