Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00033_00000_shuffled.ds.index54 linesDownload Raw Back to root
1�����M�{ k#&�&�)3*\+�13�58�=�E	M�V�WhYZ�[^]�]5^�^!b�b�b�c(dVd�d�iyq�q3vtyyz�~΀˂�c�m�����Ũ�I�i�����b��������'�i�����h�i�7�2	/3���T�j�L�Bu�� �!;)z0�0�0R4�7#:a:I;�<�?|ToWqXsYQ_�bGe����	��=���c�U�����ˬƮs���.�u��,������������������������L���Z�����,���t��	k4O�-Y�15v6�6,8�9�:�;#�+�5�����=�	���h��������^��������������a	�	�	�				�	�	�	c	5*	�*	c+	�/	i6	�:	B<	h?	�A	�E	lF	L	�N	�P	�R	V	Z	�Z	[	y\	�b	-c	Ce	�h	�j	2k	r	s	w	y	��	��	�	ۆ	�	�	��	�	��	��	��	�	c�	ۛ	u�	œ	B�	�	Τ	f�	��	C�	��	��	��	��	��	J�	��	��	�	r�	~�	B�	��	�	�	�	��	5�	x6mx7�{8�|9�}10�~11j12�13-�14S�15��16�17C�18�19��20��21��22��23��24WRq 3)�QY�?j!M%o%�%&G(
*�*�-�0�1�3�3?4X@�@]A4KbP�P�^�_�a0de,hMh(j�j�mvn�p��.���\���<������������Q���+�mJX�Z2\\�^X_�_8e(i25j�obrs<s�sO6���������=�ƍ���ؕ��$�(�^���ֱ��ں��I���ξ�����"���������2���}���������������4
"
�
�


�
�


�
�


�
#
�#
�$
K&
C)
�)
�)
m*
�+
�,
O;
�<
>
�?
iC

D
#I
�L
�M
�P
AS
8U
LW
PY
�Y
G\
�]
V_
�a
b
�p
Zr
�r
s
�x
�y
(�
��
<�
��
S�
[�
ō
��
��
�
�
��
�
6�
T�
F�
k�
�
~�
��
5�
ȧ

�
>�
n�
��
�
Ϲ
�
̿
n�
�
s�
*�
��
�
�
��
`�
26�
7�
x�
z�
!�
��
W�
�
6�
��
e�P��T�B � �/92�3�4#7o7�7�:�=�>
OLO�O,ToW�WsZ�c�e�ei�l)m�n�oQtTu�uVwy�z�{a}���V��8����@���J�d��G�.���8���q�����������������_�f���!�Y����27��_��#�$�%B'�'u*,�-�1E5x8^9X:;�;=�HJMxM�O�QZR�T�Zm=p�q�r"s3xbx�z*|�~��
���׋A��y�����D�L����H�=�Ͽ��9�����v���������l���.�,�U����Y�h���0^�����	�&X'�).
/h3@4�4�7�9:u:����������	�s��q���E����C�#]$�$v%)PP�P�U0�7�F������5-�Fx�@"�"-#/v/�0>1>2�2�2�48G:�:+=>�>�?�?�@�G�I�K�N�P�P�R=U�m�vKwax�zY�)���$������4�1�5�ܳb�*�,���$���ڽL�'�����@���?�f�a���,��	�
�
t�>�ih����9y!Z$�$�&�(�)�3f:�;�;�?@[@�@(A�DG�IbJ�L�M�N	Q�R9S�S�Y�[�\]g_T`�`�d�k�o�q���Ί��ʑi�x������^�N���]������i�����Z���*����-����������28�f���
9�hF�� "29%�%�&�'�)"*�+�-[0N4�aEd�g����������T�����>������������p���!���>��$x$�&30*�*858t8�8T:<;=�R�VW�Y�[�xze|9�N���<���8���!���ݥ�w����M���s�����'��J�������L��������|����:�&�K���R�`�����sF��	�5d�'��� � �!?"�"@#�%F'�'�(t5�57!kvl�nMp�q�t�t^uKwoxY|�|�}E~��a�̃&�?������!����<�}�Ԧq���?�����^�b�R�������R����b
2�����u� �(R*�*�*�+x-�0C1�1�1�2�2�9A>�?A{C�E1M�V<WB\�_�d�j�k�lDq�qCrsFstt1vrvxv{~���[�|�S�՘���V�Ы���)������X�X��������z�)�3���>���)���C�����5�����<�T���<��}������!�!"#"#x$n%�&'�'�*�,�1�1m6�8q<�<�>�?�BC;DmE,MjM�MkO�RU�UZa[�^__;`Ap�q�r{stPu�v@|{}�w�Ӓ{��ƞˠ<����������l�Y���?�%�(�*�,�.�G31H_IKN�N�O�OPIP%SbT�UXZGZ�Z`r`�a$b7c}cpd�j�l32z1zk{K���&���������ב”�����o���y����ݲ]�0�	�\�L��� ����R���+�
�!���`�w�����N��Y��$�Zo�$�$�%�&�(�)/"1�465y������������U�n�����)�y���Z�;�U����t�����������8Sv�33�34�E�U~\����r� �!�%;&�'c)�)D*1/�/�0�0�4�89�K1L�LcZ�Z]S]�]�]�^>_�_�`�ab�b$did�d�h�i�im�y�{5|}p�I������ي�z������ʎ+���z���J�עc����§������ܴ+�ɵ�T�z�����n������w�����M��l\�	�35Y{���*af��� t!�!�"*,y,0�6,7�8%P�P[Q�SgU�U&YCxly�|�}����8�����Տ�e���y������ݔ���� �/�E�ܡ���+���ѹs�p�&�a�O����(S�_��9l�#8%�%&�'?(�)�/[1&2�2�2C6q79k;<�P�P`[\_�`�hNi�iUj}kol|o~p��ņ���ʜ����"�����O���T����N�1�5�B���������,�C�������@�����T���kZ!4#�$&&�&36'�'v+�/90�0�1�384u4�6d9�:@@�BIQNVO�U5\�_`�l�n�pMV�@�ˊl����nI �J N �u vx �x �{ b} �� � Ȑ � s� b� �� �� w� E� ;� �� ۨ � � � W� 7� ޹ ɻ 7� � O� 2� � @� g� � � /� �� �� �� �� � � ,� �� �� �� �� M� �� J� �� �� V� {� -� <� �� �� ��  !�
!^!�!;!v!l!8!� !�"!8$!�'!D0!�7!�9!�9!_;!�;!=!	?!�B!_!�_!y`!�`!�o!c�!�!�!��!�!��!��!�!��!��!æ!n�!�!ʨ!)�!�!��! �!�!I�!H�!��!c�!$�!��!��!��!�!�!f�!��!�!��!e�!��!N�!I�!��!I�!��!��!��!��!�!\�![�!��!I�!1�!��!1�!�!��!"�""�"�"�	"37"�38"M"�"�
"2""�"�""X"�"�"|'"�+"	."�."n2"P4"5"�7"�9"�>"?"�?"DC"�D")F"JF"G"�H"�J"�L"�R"�S"X"�\"q]"2^"H_"?c"Jf"-h"eh"�i"�j"l"}m"n"�u"�v"Px"�y";�"(�"Ň"N�"�"՘"�"�"��"բ"�"��"ܥ"}�" �"��"��"�"q�"��"��"F�"��"��"��"��"&�"J�"	�"�"S�"��"��"��"��"��"��"��"��"��"Y�"��"��"��"�"�";�"��"r�"�"��"��"�"##!##�	#�	###4#�#�#j#�##�$#�%#�%#�'#j)#�)#�*#'2#$3#4#UA#�A#�B#C#xT#X#CY#r]#�&$!*$A/$�8$9u$(x$8x$�y$Nz$f�$8�$�$M�$��$b�$ߒ$39�$��$�$N�$E�$b�$?�$��$��$��$Z�$��$k�$��$k�$j�$��$��$��$:�$��$u�$��$"�$<%�%�	%40%r%�%�%�%%;%W%�%�%i)%*%<*%A+%R-%�-%�.%Z/%0%N0%m0%�0%�2%�3%�4%15%#8%@8%�<%O>%,?%�?%u@%gF%�T%V%�W%&X%Y%�Y%�Z%7[%]%	`%�a%�b%�c%�c%Lf%�g%`h%k%n%o%�q%�y%�y%v�%��%��%ł%�%��%��%��%��%��%��%F�%��%�%�%��%��%d�%!�%�%�%V�%��%��%��%��%�%7�%l�%��%��%(�%��%~�%2�%&�%�%%�%��%-�%R�%��%��%&�&[&&u&P&�&^&�&&�&"&�7&�9&$:& =&�A&�B&6C&|C&�E&?R&�S&UU&�V&`W&�X&%\&L_&6`&~`&"e&�e&�f&�m&(s&�u&�u&|w&xy&x�&^�&�&��&�&_�&��&��&��&��&P�&~�&�8'�9'�;'s>'�>'�]'8^'�^'�o'}x'Ty'�y'Lz'�{'�|'�|'�}'�~'t'�'K�'(�'��'s�'��'��'��'P�'Η'��'0�'�'`�'؛'��'d�'?�'+�'l�'��'��'��'c�'}�'(�'յ'��'+�'K�'a�'ؾ'��'��'��'8�'��':�'�'<�'��'��'��'��'��'0�'C�'��'�'}�'��'��'�'4�'��'c�'��'��'d�'uW(�b(Ic(f(�g(�h(6i(`j('m(Wp(Uq(fr(�u(�v(9w(Qw(yw(�w(Uy(�{({|(f�(8�(��(&�(h�(�( �(m�(��(��(�(r�(��(ˠ(ޤ(O�(T�(��(�(y�(��(U�(��("�(��(]�(�(=�(��(��(�(��(0�(��(��(��(��(?�(��(&�(P�(��(F�(o�(��()�)>)U)|))B))�) )�!)>#)�%)�()))�*)n+)�B)SC)�H)�I)MK)�K)�L)�O)DQ)�Q)QR)�T)^)�_)=a)e)�e)k)pk)2l),m)�m)_n)�o)v)��)��)Y�)S�)O�)ǧ)��)B�)�)м)��)L�)��)��)&�)��)�)#�)�)|�)��)��)T�)��)z�)k�)_�)**v*=*�*�*�*�**�*�	*�41*h*� *t"*w(*�<*�G*�_*�b*�b*sd*We*�m*�o*�p*-q*Fr*�r*ly*��*��*��*��*Π*��*��*n�*֫*��*L�* �*��*��*�*2�*[�*��*��*��*X�*��*q�*0�*{�*��*�*�*�*��*��*��*��*x�*#�*��*��*�*��*��*�*O�*u�*y�*,�*:�*g�*��*��*��*O�*;�*>+c	+42+R43+�+�++�
+�+�+8[+�]+�]+k^+�^+_+^`+�b+d+�d+uf+�f+�i+ak+�l+�m+Zn+�n+�n+5s+�|+7~+L~+��+�+3�+��+��+á+[�+��+�+��+X�+��+!�+$�+��+��+��+�+�+��+.�+&�+��+V�+%�+y�+��+��+Q�+��+��+�+y�+��+?&,m',:(,J(,�+,Q,,3,�3,�4,�5,n8,t9,�;,0>,&D,�D,
F,�G,bI,;J,BM,:N,	O,�O,�P,XS,U,uV,W,�_,n`,�a,�a,b,�c,�d,`h,�h,�i,6j,Fn,�v,�|,~,t�,��,˓,O�,J�,�,Y�,��,�,��,�,I�,��,��,��,O�,)-#-W-r-�-�-H44-t45-<-�-�-�-E
-V
-"-R-�(-�M-�O-GQ-�Q-�S-eV-_W-]-?_-�_-a->b-@e-ye-0�-Ƃ-�-D�-��-��-��-��-ǔ-��-С-�-}�-0�-��-<�-]�-{�-G�-0�-��-Ų-a�-�-o�-�-2�-��-B�-@.�.].�.P	.�.�.
.�.�.*.�.&.P.	.�.<.�.�.� .�!.%$.�$.�..:0.{2.i3.�6.97.a7.>.'?.�@.FA.VA.�A.'B.�C.�K.�M.�N.LT.�U.py.�{.�.��.��.:�.�.�.L�.��.��.��.��.��.��.��.Y�.n�.�.P�.��.��.��.`�.��.��.��.��.��.��.��.o�.�/�/x46//�/W/~/�//	/m$/�$/|'/�'/5/v�/��/47�/�/2�/�/+�/��/i�/u0;07480u0�0�0Q0�0�0$(0�(0*0<+0a,0C/0140u70�80+90�90JF0	H0wL0xN0S0�S0�T0�U0%X0cY0�Z0�h0Gi0�k0l0El0s0_s0t0�u0y0z0�z0�{0�0u�0z�0}�0�0��0�0�0��0h�0�00�0��0�0ƥ0*�0��0��0#�0I�0��0��0$�0@�0�0�0M�0��0�0g�0��0��0��0P�0Q�0c�0i�0��0�0��0f�0Y�02�0��0��0��0@�0��0��0m�0 �0�11�1�1�1�"1�&1{*1�;1�A1�B1_F1�L1M1<O1�P1�R1$T1hU1:Y1x\1�d1[e1�e1�j1�k1Zm1dn1|n1�o1p1�p1�q1�u1�w1p{1�{1�|149~1�1��1`�1C�1��1L�1��1��1.�1�1�1��1��1z�1��1��1N�1�1��1ޮ1-�1�1ҵ1�1[�1 �1W�1��1�14�1n�1p�1��1Z�1=�1��1��1:�14�1_�1��1��1�1}�1@�1��12<	2�2_2�2�222�22�"2�#2_'2�+2p-2�02�3252l62�:2J;2N=2�>2]?2CA2nG2�G2VH2�H2D_2�`2-a250k2�l2�o2Tp2�p2*s2�u2�w2�w2y2y2u{2�|2�}22Ɓ2O�2��2�2��2��2�2Α2ؒ2�2P�2��2F�2[�2p�2]�2�2k�2��2b�2��2��2��2��2w�22�2�2h�2��251�2u�2�2;�2�2��2��2��21�2$�2�2��2��2��2��2/�2��2)�2�2��2��2��2R�2X3�3�3P33�323�4��4ς48�4y�4��4��4B�4V�4�4r�4��4ď4v�4�4e�4=�4�4��4@�452�48�4N�4ƶ46�4��4��4��453�4��4!�4t�4e�4�4g�4��4-�4��4��4��4��4'�4d�4��4��4��4>�4<�4��4��4��435_5*545Q5Z5r5m55#5655X5o5�5!5� 5E"5�65;75N95�=5HB5�B5�F5�M5N5|P58Y5�\5]5�]5L^5�^5�`5�a5�e5�g5�g5gj5s56�6>6m6I6�!6"6�"6�%6h&6�&6/)6�)6V*6�26�C6�F6�G6�K6�S6X6�X6�X6�Z6;_6`6p6�r6�t6�u6�w6�z6_{6�6[�6�6@�6�6@�6"�6�6N�6��6@�6O�6�6.�6�6@�6��6u�6��6��6��6"7\7�7�7
77�7O7x7�7�7J27�27L;7�<7�<7�?7�@7�E7PF7RK7Q7�]7�]71c7'l7