Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00069_00000_shuffled.ds.index113 linesDownload Raw Back to root
1E��P
Mk��H��:$�$�%n)�+m.Q1�1�57V=?B4C�DdFLL}N�RYA_�_\`�cidAe�e�g�h�ocpx�������O���a����������/ O	�2
+]!�z	� �"6#!$�*+�+W,-�-�U�X�X�Y�[�[u^�^�b}c~d�d�h�}j�v�L�������f���m�W�����������
�+���T���L�G�(]+�+1,?-�/c0
1_3�6�7��W�N���5�3�̬�J�S�Ծq�e����F���s�����Q���E�m���m������7����������]�E�f�.����|	^	�	d
7~.\ �!?$%&�+I-�/@0�2C3�5jd�d�eVf�f"g0hri�i7kl`mn�o�p~q�r�r�|e}�~I���n���9�v�<���S�����ö���ѹi�����9���3���=�%���.����~�^�+�������#�#$�$K)�)�)�,
6H6�7L89C9�9�:�>@_@mF�H�LMP{P�P�R�UVX^U`�c7q�t�t�wLxox)y�z�ҕ��U���ծ���-����$���H���9�V�x�<�~�����*���.�Z����E��8�c�M���9���]�o����������=�^���(�J�N�k#3�\���N*�[�&�()-;-�-).k3�3x9�9\�����w�i���4�\�L����5�����:�4�����K����l���M��d�"()�)�,�-04:6�6R<�=�?
A�B{C(E�EM�N�N+PQ�R�ST
Z�]'^m^�w�@���ն�ķ��m�l���������G�{�����7��������o�����V	 4!�*X�U�\�&�*k,�,�3�6�7?8�9�9�:=>$@BXB�B�B�C�DdHHj�{�|h}����1���t���r���{�%���O�]���ţF� �¬R������������Q�ҷY���l���5�S��@�x���H�k�����j�Z���M�*�������%���"�����k��aqS	�5�y�Ri&'�'5(h*�4f6U7�7�7 8<�B�F�F�GuIPJjJNNP�PS)S�SQV�V(X)ZYf�m�p�r7slt�t:u)vw2y�y�|u���(�����.�K�������	t�	�	��	U�	%�	1�	��	Ö	�	)�	j�	��	4�	3�	��	A�	��	Ѷ	�	!�	�	Z�	.�	f�	j�	@�	��	!�	[�	1�	��	��	��	��	�	H�	�	��	��	��	?�	��	��	��	T�	9�	~�	|67�8 91011�12�13�'14�'15�(16:.17[.18)/19�=20|>21�>22v?23U@24�H25�I264K27$M28�M294O30aO31�U32�V33"W34�W35�Y36s[37e\38�\39�]40G_41�`42jc43.d44Ld45�e46Of47i48�i49�i50�j51�l52�l53p54r55�t56�x57�y58>|59v|60�~61D62�63T�64
�65��66v�67E�68ƙ69�70p�71��72H�73��74��75��76Z�77Y�78<�79��80�81��82,�83ȧ84�85O�86o�87��88��891�90��91��92��93��94��95�	%H �!�,96���V���B�k���ߨ4�j�������ο �����{���6����0���g�+�h������+�Z�0&
)'
�,
/-
^-
�-
+2
z2
;
�;
|?
	I
?J
�J
8N
Wh
�j
al
�l
m
�n
*q
�q
~r
�s
�s
�s
lt
S�
Ɖ
F�
G�
�
q�
)�
|�
$�
5�
i�
��
"�
��
3�
&�
��
�
��
2�
��
��
�
�
X�
��
/�
��
��
�
5�
t�
��
��
��
��
��
%�
	�
D�
6�
��
��
��
��
��
��
Q�g�	r��]�q�!�"�#�%�'v.�/�/q456P7
?�FjKP�P�U�V�X�\u]&^�^d_``abKd�d�d�g*i�m�z��`�-�'�m�����S����v��	�^���_�D����o���e���N�e�"c997�_#)�W�GhrQ J �"FN#R�R�T�\*]!^�ac<chiCp�x{W{y{i|�~<6�����Ď������S����p�Ӗo�����Қr���+�A��'�y�ͣ'����8�)�������5����.�����������0�G���<�l�#�a�����������z�*���/��98Z&��y%�c��
�<�<�>&BrB�C�D�E�E�J�nmq�q�qs�s�uMv�vz�}�~H�!�ւ��҇�J�/�g�������v���I���g�N�ê��<�N���z�h���E�!��99�����i�������v������?���B���C���y��� �"L$�$i*5/�1Z23J6�6:�AyDrEH�HJ�J�N>T�T�U�U�X�Y�Zw]	_~h�jgm	nQo�o�qQu|z!{π����o�2�&�������5�Ò����U���h���������6�m��N�t�����#���q�������A���������5�4�	�100�1016l�����@+�+�1n3�4�4$5�5	6�6M7�7�8�9�:�;�<�@�BWF�G�I"J�J(K(LmLKM�N W�W�WXYZ_�`7a-blb�dff�f�i�j�n!q�{g},Y���H�ۄW���r�{��G�]�{�_�ڠz�W����b�J�Ů�����߱���+���"�d���W�h��������L�������J��nY��I1e� �>?�?�@�C�F H�L�NVQ�S�U�UmV�W,Y�\_=`a�b�d�f�g&hDu?v�v�w"�V���7�b���֬ ��ҴJ���ܶ�b��&(((K(�/;0x0�02D2�@�A/DAG�J�S-T�c�d�efjh�j�j�jl"sDuj�����ƕn�<�I������A���o�>�X�K���E���-�C�p�������x�9����c���O�T�P���������/������J��1����e�fhjl>m�m�p�x]y�z�z�{����X���[�O�������&�������&�����>a�<J102m103����! #�j�l�ompPq�q�v)wdy�z�{j}�}T�U���.�r���4�f�ď1�����104�g�6�������b���K��ԲX�����˹)�����K���a�����X���������7�K���[�2�<�z�P�������0�������"��������z���S����	�	e105�106
Hi���	i��&w*�*I-�-M.�.�.�/�]�]ja�a;bh�h0i�iRk�lp�pɔ���I�Z�ʛ��������l�����r��RS� �!y$t%�&�(�)�*^+D-�-�/j1hH�K�KBRSiT.U�V*W�X�X!Yt[�\E^�_/`Dc�d�e7f h�h�q�s~v4xBz�~,��F�Đ��9����
�5�y�B��+�5�V����֠ݣ[�������`�޴)���r�~���{��w������f���k��%�4@EjGvK!TXBY�Y~Z@\v]%^3`�cVn�n9� �� q� r� 
� � �� �� �� ˺ �� �� )� r� �� � V� �� �� Q� :� �� ;� v� � :� �� &� '� d� �� �� l� �� �� �� D!�!n!�!�!107!g!�
!�!�!|!v!�!�!{!�!$!�!!l!!!�!!)!�)!�*!:0!?2!�2!i5!�6!�:!E;!hV!
W!�W!FY![!5]!�_!fa!#b!+g!�g!�i!�j!Lk!�k!�m!�o!�p!�r!�s!�s!�t!�y!��!��!'�!8�!��!��!�!��!'�!��!Q�!`�!��!@�!��!|�!��!��!��!��!�!��!S"]"1"�" ""�"�"�"!"}"�""�#":$"�$"�$"�%"&("E8"l8"�B"TD"�D"�D"�F"QG"gO"�Q"�S"W"8W"bY":["�a"�b"�e"<u"�u"�v"�v"�z"�"��"�"ӕ"$�"M�"}�"�"ܛ"l�"O�"Ŧ"G�"�"7�"$�"]�"��"Ը"?�"��"!�"��"��"U�"�"�"��"��"?�"z�"/�"��"��"��"��"��"��"��"#�"^�"��"��"��"��".�"��"�"^�"��"*�"*�"n�"��"E�"��"b�"P�"5#I#�#�#|#z#�#�#q#H#L$#2&#�(#o+#�+#y,#*/#�7#�8#9#c9#�9#S:#@;#�<#p=#k?#�?#b@#<A#�B#�B#OP#�Z#`[#�]#�`#�f#j#mk#�q#�s#t#.z#|#�#��#�#Ҫ#��#l�#�#��#ٵ#�#��#��#��#3�#��#x�#��#d�#��#l�#��#�#�#��#��#��#1$4108$$�$� $�!$�!$#$a#${$$�$$�+$�,$�-$�/$Q?$�F$7G$XH$I$aI$0b$c$7d$~h$lj$�r$�$΃$��$��$��$i�$.�$��$@�$ߎ$��$Y�$�$��$�$l�$��$��$@�$Μ$��$��$��$3�$b�$:�$]�$��$��$��$�$|�$��$4�$Ȼ$O�$�$��$��$��$6�$R�$U�$��$��$T�$��$4�$��$U�$�$7�$u�$%�%#%x%�%%L+%�.%6/%�/%K0%B1%M2%b2%�7%H:%;%=%�>%?%$@%J@%CB%�B%-C%dC%�E%BM%'O%>O%�O%kU%AV%�W%jY%,Z%�[%m\%�\%�]%�`%la%b%�e%Wf%�f%�o%ѕ%Ė%H�%1�%[�%w�%�%Y�%��%)�%$�%f�%S�%/�%�%��%n�%ǫ%ܭ%��%�%R�%�%-�%`�%��%;�%l�%��%��%��%��%�%��%�%�%c�%��%�%��%1�%c�%��%(�%�%B�%p�%9�%�%;�%N�%�&,&�&�&�&�&�&1&�&(&7)&�*&@+&�+&�,&-&�-&8/&;9&�:&^;&�<&=&�J&>]&�`&�e&�e&�g&�o&8p&�q&�r&�r&Vy&{&�|&?~&(�&��&�&ׄ&J�&o�&��&��&|�&	�&F�&-�&k�&��&��&H�&�&�&j�&F�&�&Q�&֨&��&�&X�&@�&��&��&!�&I�&�&��&�&��&�&�&`�&��&#�&��&W�&��&��&��&a�&��&�&��&c�&��&Y�&z�&j�&��&J�&��&��&��&��&��&a�&��&!�&B�&_�&4�&j�&��&�'�'9''0'(	'}'J'e'')'H'E'e#'[$'%'�*'�,'.'�/'1'_2'�:'�<'�='�>'<?'�@'�@'�B'IC'�C'hG'�G'gI'�J'�]'�c'e'pe'$g'�k'l'/l'�m'An'cq'>r'}r't'�u'�u'�w'By'z'A'�'њ'��'v�'��'C�'%�'��'��'��':�'�'�'��'�'��'t�'��'��'P�'��'0�'�(V(�(�((7( (�"(6$(�$(?((�+(��(�(��(�(x�(1�(ޡ(��(Ѷ(t�(K�(d�(Q�(l�(p�(��(��(�(�(n�(W)�)])�)�	).)~S)�V)/Z)"\)�\)�^)._)�b)�c)9u)-w)�w)�w)x)D{)�|)~)#�)~�)�)��)Ҍ)��)�)��)"�)L�)��)0�)~�)��)�)`#*�#*$*'*t'*�)*}C*iH*�H**M*�N*�Y*[*�\*�]*�_*�a*rc*�e*9f*�g*l�*��**�*��*��*��*�*͡*�*�*ө*��*\�*�*��*/�*µ*^�*�*:�*��*(�*��*�*��*��*1�*l�*�*L�*��*109�*{�*��*�*��*��*��*��*�*��*��*��*��*��*��*g+*+9	+�	+�	+R+�+�
+�+J+�+�+�+G+�++H+g +`#+s$+�&+�&+�'+[(+�0+u1+�2+3+.=+M+jM+�M+�T+�U+	V+W+�Y+]+�]+"^+�^+�}+d+�+(�+k�+?�+��+�+�+y�+ŝ+�+��+h�+:�+m�+��+ί+��+W�+��+͵+3�+��+*�+��+�+��+g�+��+�+��+&�+��+_�+S�+��+^�+��+��+��+��+��+��+��+a�+b,�110,�,�
,I,�,,a,�,�,P,�,,,],�,7,{ ,�!,J(,U(,�,,�.,/,�0,�7,=:,�:,&?,�B,SE,�G,7I,#J,�J,"L,�M,�N,P,�S,�U,�j,k,��,b�,��,�,i�,ʙ,�,��,�,��,��,��,*�,��,��,۴,��,�,��,��,o�,��,111�,��,�,��,%�,��,��,!�,J�,��,�,b�,�,J�,��,��,i�,��,w-�-�	-A-�-�-�-�#-�$-�%-�%-Z&-�/-�/-n9-qP-]-�]-_-�a-_c-Jy-z-�-P�-,�-{�-�-�-ʛ-��-��-ݪ-Q�-��-'�-Ʊ-x�-�-p�-��-:�-P�-h�-s�-��-<�-��-��-��-l�-��-��-A�-��-��-g�-��-��-d�-V�-��-8�-q�-��-�.�.�.$ .B#.$.4%.,*.�..H4.6.h6.�6.G7.>.+>.mB.lC.ej.�j.�k.n.�p."s.�s."u.��.��.��.��.�.�.я.Z�.,�.�.$�.�.ղ.:�.�.H�.��.��.$�.9�.y�.t�.!�.��.�.��.H�.5�.�.%�.j�.��.��.��.s�.��.|�.#�.d�.L�.��.:�.��.�.��.��.t�./�//�/9/B/]/M/�/�/�/�/./5/A/*&/�&/�'/)/V/�Z/�[/\/Y\/]/<]/�_/�a/c/qd/�d/�e/`f/�g/)i/Zl/n/Pn/q/I�/�/H�/0�/C�/�/]�/��/L�/��/��/��/"�/ɜ/ߞ/=�/��/ʠ/%�/�/o�/�/��/6�/�/��/�/��/��/��/��/��/��/�/*�/B00�0{0
0�0�0�0�000	01120q1130�0�0}
0�0�0� 0�!0�!0,%0~*0�*0@+0_/0-10�30`608@0*C0�C0�D0�D0E0�E0�G0aU0�V0�W0VX0�]0Kb0�b0dg0Fj0m0�m0�v0.w0�x0�x0Xy0�y0q�0y�0�0��0�0��0�06�0_�0��03�0�0�0O�0��0s�03�0��0^�0��0x�0K�0��0�0?�0I�0c�0��0�0a�0��0�0ٹ0W�0��0��0��0��0�0��0��0��0��0�0��0�0��0I�0��0��0��0��0��0��0b�0)�0J�0��0�1+11=51�51�81%91X91<1+?1�?1�K1�N1�P1�V1�W1�X1�Y1�Y1:Z1�Z1�Z1kc1`d1�d1�g1�n1�n1��1ڒ1%�1s�1��1�1�1D�1ɢ1,�1��1��19�1�1y�1��1^�1��1��1�1g�1��1��1<�1
�1V�1��15�1��1;�1y�1��1��1��1��1��14�122h22�2�2�2�2�2�2:26+2�-2M.2�H2�H2BK2XL2�N2�N21R2�S2U2	V21V2�V2�_2�`2�i2Vn2�p2�u2yx2��2�2}�2r�2��2��2��2��2�2N�2+�2�2�2+�2��2��2��2N�2)�25�2W�2��2V�2��2+�2R�2�2��2:�2��2�25�2��2