Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00055_00000_shuffled.ds.index98 linesDownload Raw Back to root
1 2�Fj �3V4
e:8�] )!T#�%0&�*�+�D�H	NRN�P�P�Q�VAxNz~߁�׆���%�&�((+b�e��.�e�D�������u���y�5�7��������������X�L�_���h��(�*�*�-}.�/{J�JM}M�RT_U
VBV�V�Z%[K\�]^�`c�c�e1jZjtj�k4m�mwzw������
���d��}�������Ĕ|�٬�ս޽�K��b�������k���G�+'4�4�54;�=1>�DFE&]�]�^_]`�`c,n�p1qbq�q�qKrdr�r=s�y[zlz~ہ5�9�ߊ(������Q��V�j�����֛����!�ĥO�;����]�s�\�����u����3�#���K�f�s�~�����6�
!�O~�j�kl�lmmp�p�sDy|`}�Q�z�Ñ������������צ�/������öJ�[�l����x��������k���b��D�e������2�;���7��U�>!?#�#�$z%)�)�)�)�.z5�:�C�G�H�K�L�M�OR�a�b�b7c.c^d0fZl[m�n:o}p4q�r�uTv�w	yBy)~�s�
���,������j�M�g���[�������1��/6�Hy
H.Z�HpJONVQPU�X�Yg[s\+`�a-c�j�jnn q�t1uez�}�y����m���?��9����u����1�F�y����d�w���)���a�����������������6�z�o����n�}���/{8�7	�	���)R�#���� W"�#).�013�4w7X8�;�HEV�V7Wl`f�hiUj1p�r�shv����O��ُp�6�N�Ġ����R��:�I���$�ĵ~�H������R���y�����5�]�n���e�������<���'����������
�aib9�@�AaC�C�C�EQK�L�O�O�OLVW�W[�[�]�]4^�^�b[n�o�p�p4t]t�way�y/z�}ߌ��
���U�!��&��y�X�������������� ���e�U���*�����J��	�	q	�	�9	�	10		.	�	Q	�	e"	�%	�(	�.	9/	t/	0	15	�:	�<	�>	?	 @	�@	jA	9u	�|	i�	n�	��	��	C�	}�	��	b�	 �	i�	(�	�	��	��	��	s�	��	�	�	��	��	��	ش	Ź	�	��	�	
�	��	q�	!�	��	9�	��	��	0�	��	S�	�	��	:�	\�	�	��	��	��	@�	��	o�	��	�	��	S�	E�	g�	��	��	�11012,13�14�15 16D17�18�19�'20�)21�.22�023�324o625�6268I27J28XJ29�N30�Q31yb32�b33d34�f35�g365h37�y38�z39�{40|41�42�43Z�44�45T�46�47�48�49v�50��51��52G�53[�54ʏ55��56ː57��58p�59�60��61��62S�63	�64X�65��66�67��68^�69
�70��71�727�73/�74[�75��76�77��786�79��80]�81��82��83	:$�&(�(�+�-<0�3�7:;t?�D�D6G�G�HkI�JJKROQ�UX�XAa�b�cxdVe�hTrAtu�z�{~|‘Q��T�}���И+�%����à��:���ʧ|�������5�����˿
�.�M�0�j���������@�v�����A������)�q���r���I�`5��o	U���NK�({t!�,a/�/�@�B0C~D�EsFNJ�KOL�LMqP�Q�Q8SuT�V3Y\\_U`OdFg_n4p�p�p�s�srx<y{y���-�[�~��9���U�����a�#����1�s��
`

;
�
�
	84


C
�
�
�J
�#m$'�(J*&7�]�a�b^c�c5� �Z�X������3�C�Ŗ���˛2�@���}���Բ�
���������%�}�����
�)�D�}���w�����T�a����%���5���c�u�P�&��y�������n��H�<���'�))*:.�1Oh�jZl������˂N�2�˧��7�ĸ�/�Ǿ��85��������3���J��������9���e���8�|�D����C��������9�Y�	c	�86�"@
�
�
[�`O�qw@�!�!�'�)�*�-0�0(3r3q7^8j;GC#D�TMVuWC[�]	b�ckd�i�s�s�|~} �M�,���Մ��G��ד���(�o���k���/�d�s���,���M���������1���������������2����O�r����������@5AkH�H.I�KQ�`1g�gth�l�u?�E��j�8��������Ԩө�"���y���%�l���P��C�>�$�^���.�z��������/���n�	�@���F�!���87>
���$%?&�'�(�(y:�:�;"<z<�<A�B�FdH^IMR�R7Y�\�]�]�^*_�`�c�i�k�mno+pQt�t~̂���ĉm��B�G�MqX�X[3\�]�]_�`�a~d�e[j�k�r{sBz�z�z�Ƃ���ϐՑ��]�ɔb��M����Ș1�ǟ�r�1�����ϧ������t�d�f�*�Y�q�������/�G��'�#���[���e�Z���^�����X�����A����������Q&���2���4�[�����T��)���-�+�B���͛�����I�����,�T��������ݳ����"�����T��������$�%�&`'�'+)�+./43(4Z4o7�7>8�8�<�<�A�D�DgEF�G�I�I�R_`�`cId�dQe�f%iEo�o1qrqx�xyy�yz'}�~��ۀ��8�M�{����ϟ-���$�ެ88�b������ �n�;���%�p��K�����p���C���5����0�����o����H�����;�*�r������������x�1��� � @$%�(|)�*b+!.2s3 5e=�=�B%C�C�D�F�G�I89O>Q`Q+RzR�V�X�X|[9\|^?`�b�dWe%ygy�yzQz {�������v��*�O�)�:�t���Ѽ��1�A��W����y��n�!�m90�;�
����?w#���/:0�1"2&3I3�34�4FBGI�J�JUL�O�RRS�U3X�X�[?\�]E_�_v`�a%fgbj�w�|�~�\���Q��M���k�ߕx�З7��E�ؙ�������������������#�#�#n$�&7'�(+O36�6�7;�;�<A=.>�>}@�B�B-G OrP�PQ�W�[
\f\]>^�^]kZ����������;�{�����=�V�|��8���������N��������p����0��L���S�{�L�/���
�����v���u���a���Z�,���e F � � % � J �" �$ �% �& P' �' �) &* 80 -9 s< �F �G mI N 4� �� k� � � n� �� ܹ T� h�  � (� <� L� �� �� ]� �� � �� �� p� �� �� &� `� � ,� �� �� �� f� �� W� �� �� d� �� �!
!P!�!#!�!C!/!�!�!�!Z!�!�!9)!91,!I,!`-!?!�A!B!9C!+E!NJ!�M!�M!GN!�N!QP!�V!:W!�W!�X!H]!�]!r^!�a!�b!uc!�g!i!�i!�i!&k!5o!�o!�p!{u!v!)x!�}!�~!�~!�!d�!�!�!M�!ӝ!�!�!��!��!.�!�!��!�!v�!��!0�!H�!a�!��!��!u�!V�!��!v"["�"�""X	"�	"�92"�93"�
"�
"J"�""`"u"+!"�!"	""(",)"|)"�*"�+"v,"�."p1"�7"%:"o:"�@"�F"I"�J"^K"�"��"�"?�"��"E�"��"��"Z�"��"!�"��"H�"��"D�"�"1�"O�"��"��""�"+�"|�"s�")�"��"��"`�"u�"��"94�"��"T�"��"��"<�"R�""�"��"U#r#�#�#x#Q#g#�#�#�#�#�##O#�#�# #* #P #� #2!#S!#e"#%#(#�(#=#x=#�=#>#�?#�?#�@#�C#�L#0N#vN#�N#�W#�W#X#+\#
]#�]#�]#_#c_#Jd#�e#pf#�f#g#�h#nx#�W$�X$n[$�_$Ec$�c$m$n$$p$�u$(x$+{$�{$��$)�$��$5�$׌$��$4�$��$�$��$�$��$F�$��$,�$��$Ű$��$��$U�$Z�$m�$%�$��$�$��$��$2�$��$��$k�$$�$��$V�$z�$9�$D�$��$�$�$�%�%�%�%%�%�%<%%�%�%�%�%�%�%�%�%%+ %� %�!%'#%�'%�'%}(%}+%�S%�S%uT%�T%�W%Y%�\%�]%�^%�_%1b%�g%�j%l%Dl%p%,r%s%^t%�t%�w%�%��%S�%J�%�%b�%�%Ƥ%�%r�%��%K�%��%��%��%*�%��%��%�%��%��%�%��%5�%P�%��%��%��%O�%��%K�%��%��%��%��%}�%��%�%?�%��%��%b�%0�%`�%��%�%�%D�%W�%�&�&�&ő&#�&ۙ&ƚ&��&�&>�&ݫ&#�&�&K�&ݶ&r�&t�&M�&�&�&��&J�&��&!�&��&��&�&��&��&w'�"'$'�$'�$';%'G&'f?'�@'"A'J'?J'�L'$R'ES'wS'V'�V'�X'F['#]'�^'�f'�h'Qj'�j'k'�n'�s'�t'�w'V'��'�'�'��'��'ы'S�'M�'1�'˪'i�'�'/�'��'��'��'��'N�'��'l�'��'}�'��'v�'��'��'3�'s�'>�'�'6�'\�'��'��'<�'��'��'U�'>�'O�'��'�'{
((�(A(�(("(I(�(}([(Q"(|"(�((G.(�.(�0(�5(lF(�R(�S(�X(#Z(4Z(8[(w[(�\(�\(^](�^(<`(q`([c(If(�f(�f(g(�g(�h(ki(`j(�j(�z(�()�(V�(��(�(Ɔ(j�(�r)�r)�|)f~)�~)��)�)d�) �)L�)
�)��)Ƒ)h�)�)x�)��)��)�)ɜ)f�)��)&�)9�)��)��)��)��)��)2�)
�)t�)��)�*�*�*�*�	*f*}
*�*�***�*J*�*�* *& *!*2'*�'*�)*,*c,*�,*�-*95/*4*)5*Q7*�:*S;*�;*U<*�=*�A*^J*�K*�O*JP*�d*e*�g*5i*?j*�j*Fk*a�*�*��*�*c�*��*�*+�*͚*y�*��*��*c�*:�*��*B�*>�*t�*֦*��*٨*X�*ʪ*s�*Ϯ*ܯ*α*ش*��*��*��*��*��**�*_�*�*��*�*��*a�*t�*��*�*r�*�*u�*��*<�*�+�+f++�++�++5 +� +�(+�B+G+^G+�G+(H+�H+jO+�O+�O+�Q+�R+_T+/U+�U+�U+HV+�`+Mb+mb+�b+�b+c+�c+Id+�g+�h+�n+�n+�o+Ns+xu+�u+lv+�v+.w+:y+�y+I}+�+�+J�+D�+�+��+&�+��+ �+L�+`�+'�+��+F�+\�+96�+P�+��+��+�+n�+V�+��+��+�+\�+��+��+/�+!,L,?,",X,�',*,D/,%0,�m,pp,qq,x,:x,�},~,�,v�,=�,��,��,�,�,|�,�,j�,��,��,ْ,��,b�,H�,u�,o�,��,3�,ܨ,Y�,q�,��,A�,��,1�,��,�,3�,,�,��,��,��,B�,��,��,i�,L�,u�,O�,o�,��,v
-�-p---6-�-�-_-�-�3-�3-24-�4-�6-H7-.9-�9-�?-9C-�C-�E-<M-�R-�S-KX-�Y-�_-�g-Hh-�i-�k-�m-n-_o-�o-Lp-Wq-Br-�r-�r-t-�u-�v-zw-	z-h�-�-ѡ-�-��-��-Ө-H�-H�-H�-��-{�-��-��-�-G�-;�-[�-��-��-��-/�-H�-A�-z�-�.�.�.�.0..n.�.�.�.
.B.5.n.|!.I#.�&.�&.�'.(.Y(.�)..+.97,.l,.�,.m-.�/.S3.�4.A5.�7.X.xY.�Z.8\.�f.h.@h.xh.*i.�j.�l.�v.5w.�x.�y.�{..|.�|.}.c~._.��.�.��.�.+�.ޟ.�.W�.C�.��.��.7�.��.��.�.��.��.��.��.��.�.��.��.��.�5/�5/o;/�>/�F/�I/J/K/VM/<N//S/QS/�V/�b/�c/Sh/*i/k/p/xq/'u/�u/kw/�x/z/�z/,{/:{/}/�/�/�/��/E�/��/A�/p�/A�/_�/��/��/��/o�/ѩ//�/j�/��/�/��/��/��/��/�/ܸ/��/v�/f�/��/Q�/t�/��/#�/?�/��/��/`�/��/��/!�/��/��/Q�/��/g�/��/H�/^�/��/}�/��/��/P�/��/��/!�/��/]�/��/�/��/�/��/-�/{�/��/��/�/=�/��/��/g0,0�=0�?0<C0mC0�C0/K0�V0vY0�Z0�]0�a0�a0�a0Gb0�b0�c0*d0id0�g0�h0;j0"m0;m0io0�o0Cw0�w0tz0�}0��0��0�0��0Lj0Ŋ0~�0��0��0��0��0��0��00�0��0��0��0��0C�0��0`�0E�06
1l141|1�1�1;"1�"1�$1n&17(1�+1�01�41U51�61@71n81�81D91�91�@1&A1�G1�M1�N1�N1>O17Q1�R1�S1�T1�W1X1�X1�h1�q1�r1�u1�v1��1�1��1�1��1�1��1��1U�1�1�1��1��1��1��1=�1��1�1��1��1��1�1U�1��1D�1��17�1��1�1:�1@2�2�2�
2�2X22�2k2�2&2^+27,2�,262/72R;2E>2C@2�D2�F2�H2PJ2P2�S2�T2`^2�^2W_2�`2c2�d2jy2�y2�}2��2�2�2,�2��2�2��2�2��2u�2��2�2@�2Ʋ2J�2N�2{�2��2��2�2��2-43]<3O=3�>3I?3�A3J3�N3S3k]3�^3*`3{b3�f34g3i3�3	�3H�3�3	�3��3T�3~�3��3O�3[�3+�3L�35�3��3f�3��3��3��3�4	4�	4r4!4�4�4C4�4=4�4984�4�"4�$4c'4(4C54~64?94;4j;4�<4�>4�@48B4J4ZL44M4�Q43R4vR4�R4�V4�X4�[4\4�]4�b4hd4h4sh4i4�m4=n4�n4=}4.~4m~4w�4Y�4�4Շ4C�4��4�4��4��4>�4�4��4��4 �4f�4��4��4�4�4Q�4޼4�4O�4l�4��4��4��4�4��4��4N�4��4��4��4	�4]�4f�4��4��4
�4)�4M�4/�4�4t�41�4��4d5"[5�^5�_5�a59b5�b5�c5)d5�d5e5�i5�n5�p5xt5�t5�v5�w5Kx5�x5�x5�z5|�59�5��5��5M�5��5��5��5И5m�5A�5ؚ5�5	�5��5ݢ5%�5��5}�5��5ʹ5C�5��5��5��5��5.�5��5��57�5��5f�5��5��5��5�5��5��5��5��5I�5V�5f6K6s6�66�6�6�6�	6.6_6�6�6