Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00036_00000_shuffled.ds.index66 linesDownload Raw Back to root
1�)n_�	%{��/N7�7M8s9�;W<�<=�=&FzF�FG�J��

,���!�+D0�23$48T?@*AkA�A�C�IJ:Q�T�U)V[V0\�\�agc<d�d"ji�*�h�I�g�ׄ�1������6��,����֞��:�������q�s���F�|�:�����6�u�����j���������)����d�����1����O�����I�<Q
�
\��� �!J-�-c/�/G0e01�9�:6<�@�@�AnC�GuH�I�J8U�pqq�qr'rRr�t�uQy�ym����ȃ	���!�ՌҎ*����������������&��������A�����������N���]��������
$�����[z�� u �!�+i,�.�12�2�3�3k:�;_=Z@�@OA%E�E�L�M.N�OW-Y�Yb\�`�a�a�b�d��2�������H�+���k���<�"�B�3�A���1�347Q�4��5K�;b����.�K +"U"�#f$�%)�519;&<�<�=0?>BC�E�FWI�IJyK98�?�@�CPD�D[ECU\\W]1_*aBs�s�s�t�tvMvx/ytyG|�|�}�}�~8�ր��5���}������V�V��	^	�	�	J	�	5	�	�$	U&	q'	�,	#.	�0	T4	5	�5	@	�@	+B	_C	�I	 J	�J	RK	bK	"P	oP	�Q	
S	2\	�]	�`	�a	�b	Vc	�r	zw	�y	�y	|�	�	��	��	��	�	�	��	4�	R�	��	e�	��	��	t�	��	�	k�	z�	��	:�	V�	]�	��	F6|7�8N910�11�12 13�14�15�416S917�C187G19�G20�I21hM22�[23�`24�b25�h26
j27�j28�m29�u30w31o�32z�33��34C�35�36��375�38��39@�409�41As#�#h:�;8<#=A�B�E�H)IsI}L*MSQ�QCT�T�Ukf_g�ipk��ԩ�d�Ȫ9����R�����p���|�V�����������B�������B���$���"�c�!�"2�P�G�C-�-x0�0(1G1p2�2�2.36X6�6�6;8�9=�=�>TC�C�D*E�EdJ9^�^�^N_�`>aed�e�ebf�f�gih�hj�k�l�mhn�o4����l�>�����Q�N���X�T42B�0���sD)�)h*�+�,�-p1�2p3}3K4>7t8�9�;_<1>{E�E�E�L'_�`%ane�k^l)m�mn4olvg}R��������b�m�ʚ43����t�ȟb�5�s�%�#�����k���8�	���������2���z��b�7L��z44�45�46hn�/�2�2�3�47506�6	9�:4E�K�Z�Z�\]=^�^�a]d�dQ����������������K��%��/���i�����U�����n�u���r����������|�47 48p49� �I�ngk";"�"A&i&^�~$	�50Z��Z<��51�Bk'��U+�-	15�5�6-;�;�@AuA�A52HGNOP�PGQRUMU%\�^�^za�a-d�d)esf�f�h4m�ogp�r�u�u�w�wx�$�
���_���+�e�K����;���53�D�����������������Q�A���?�������������)54�%�'�(X)�)[+y+�.�;"<"JV�YR\��_�׍>��x�I���ޕ��#��������������f�������������s��� �������b55�56�
���#�#�/"1�2�4@6s6�647h@�@�M=O{O�P�PS�U[�\.k�kzl_sttu�w�������?����C�����%��K�#�?�t�������c�A�b�����^���r���z�]���57��*�A��5���X�o���5��R���������#3� �!b#G,�-�-	1�1\234-5B8x8�;�<=�B�D�G�H4IMIGJ�L�L�M~^�^_�awb�ya��A�O�d�]�̍]�������`�����>�ˠ�Y�������ֺ"��/���%�\�������������>�N���|������d�������5���t���j�1�>f"O
�5+7�>`E�F}G�K�K���)�V���؏��~�Q����b���������A�o�߱58���6�ѵ���#���F�0���(�59�.�����^�������g�	�T�;�f��������E��7%�!;"%^&`'�'�(|/q0>23A�A�C�GI�N�O;Q�RKSGT�T{VXvX�X�Z�`�`�b
d=f#g�i�k=lkmn.pq6s�vPwGya{�~�́��‚r���C�����������ɢ�������r�����=�`��!���P�����8�Av	o
�
]��Cj��K�L�LQ�Q�U�\f�f�f�h{lcn�n�nmp�qt4t�y}60�|�����Z��S����Ѣ�ߣR����������մ���������K�.�8���A���B�w�t���7y�8�8�:<
ArD�D]EoI�J�J5KM�M�N�TaW1YC\/]�`�b@e5gzg�g$kXm�mMnTs�s�sswjx�x�{�|
~�������^����>����8�����ů�B�X���������f�:������������^�A������U�>�V�������.�I�������r��0� 5#�mBn�os�Y�61�ד��}���^�����`�	�0�O�U�U�ʪ���/���I�_�|��	
x�K
�^ �*�4^7�:)G�G�H�I�I�ISPLRoR*SjS^U�VvXrY�Y/�����Ԝ��q�ݟ���o����v�����d����յ��P�ݷ*����������R���E�������������������������;�[�Q���#�:?�B�C�D F�GJ�J�M�O�QR�TsU3W�W!X�Y�YZZ\O^�^�gI�À��ф�2�K�����P���]wZx�y�~M�؃:�p���E�>���@�^�R������������K��q����ʷ~�q�v����~����D������X �Y I] �^ �_ $a Yh  q sq �t Iu �y T| �| �| ?~ �� �� � �� =� i� �� � ذ �� ٵ �� S� �� ,� �� � �� � _� � ^� �� �� T� �� 6� �� �� � �� �� � z� $� �� �� �� �� �� )� �� �� �� � \� �� d� k� 
� �!v!!�!�	!�!	
!8!U!!�!!�!!�!!%!�(!+!b,!�/!m0!?1!�V!D\!.�!�!��!�!��!��!l�!0�!¹!��!c�!��!��!�!��!��!E�!+�!K�!��!�!��!C�!��!/�!f"R"�"J"N"�""1"�"Z"�"�"	"|"�"�"p "� "0*"�*"��%2�%2�%�%��%<�%W�%W�%��%6�%�%j�%��%�%J�%ʶ%\�%��%��%�%��%�%û%ս%��%�%��%��%�%�%��%s�%3�%��%��%��%'&�&5&�&�&_&�&�	&�&�&�&�&�&�&.&/&�&G&�&�3&n6&e7&�7&BU&oX&�Y&W[&W�&À&�&ƒ&�&�&Ғ&�&��&i�&��&g�&��&{�&��&�&q�&>�&ݦ&
�&m�&̫&�&R�&ܵ&@�&ӿ&]�&/�&��&��&�''�'s'�'
'[
'('U'�'z'�'�'�'�'�'�'�'�':'n:'�:'?;'='�='�?'6@'�B'�E'�E'+I'�T'UW'�W'X'�X'&\'�^'�_'�m'rn'�r'$w'Uw'�w'8|'~'�'\�'��'s�'J�'U�'�'B�'�'5�'w�'��'��'�'��'I�'_�'��';�':�'1�'V�'�';�'��':�'K�'��')�'��'��'��'��'��'[�'��'H�'��'��'��'��'��' �'o�*݉*��*ʍ*�*�*0�* �*v�*{�*+�*��*�*�*�*��*��*G�*�*ڨ*�*�*��*��*��*Ϋ*��*Ю*��*n�*��*�*v�*��*��*T�*��*��*3�*��*i�*��*��*��*��*%�*�*��*h�*��*��*��*��*��*n�*W+r+ +\+H+h+H
+)+�+�+�++�+�+�+�+�+�!+E"+�'+�'+�,+�.+�0+:1+6+�8+�:+2?+B+�B+!C+PH+�H+�J+�V+U_+Zm+�m+�n+�o+t+vt+�t+�v+Ey+�{+|+ �+R�+$�+��+̅+�+&�+U�+��+�+M�+��+��+��+;�+��+��+�+��+J�+��+��+��+��+V�+),�,�,,�,W,c,�,�,a,,�,�#,�#,H&,�&,L(,+*,�*,5,,�-,'.,0,t1,�1,�1,2,�2,3,x3,54,Q9,�9,):,�;,H<,�<,�<,62=,�B,�C,DD,TJ,7K,L,$L,�Q,�R,lT,UU,�V,|W,Ke,Yl,0n,�o,p,�u,�z,|,b},:~,�~,��,��,͇,��,��,4�,�,��,��,Ϥ,��,��,��,��,3�,R�,5�,��,]�,t�,��,m�,��,N�,�,��,��,�,��,�,��,F�,��,--`-�-�-S-�-K--�--v-A1-a:-�:-�:-;-�;-�;-@>-B-�B-�C-3D-E-�H-}I-/J-�K-NM-�M-$O-�P-GS-�U-7Z-e-�g-zh-�h-�j-�k-�n-@o-�o-v�-�-d�-|�-��-��-��-��-��-�-��-ݬ-B�-'�-r�-��-3�-}�-,�-E�-P�-��-��-$�-�:.�=.
@.�K.�M.t.7�.δ.��.̻.�.��.��.(�.��.E�./�.��.H�.r�.��.E�.��.@/�/�//E/�//z!/�!/["/'/�,/-/fE/�H/�I/J/�L/~P/�S/T/�T/@e/�f/Ag/�g/Nh/�i/�l/Vn/Wo/+w/�w/��/ƒ/�/<�/?�/��/�/�/Ͷ/x 0Z$0�$0�%0&0�)0S70�70�80d=0>0@0�@0�@0(B0�F0�I0
J0�O0�Q0S0�`0c0�d00j0�k05l0�l0m0�m0�o0Pp0q0.�03�0��0��0��0��0}�0��0��0}�0;�0�0=�0]�0H�0X�0x�0��0��0��0��0]�0��0S�0��0
�0��0��0��0��0��0�1Y1�1e1�	1�1,
1M
1=1A%1_71:1G>1�>1�?12B1BC1�C1#D1,E1G1�J1�U14X16\1�^1�_1aa1Jd1�i1�k1�k1l1al1�m1�n1!q1�w1<y10�1֜1��1`�1'�1��1u�1e�1Ԫ1*�1��1��1��1�1��1�11�1��1��1|�1��1U�1��1��1��1$�1f�1x�1q�1��1(�1��1��1��1��1�10�1��1/�1b22�P2�S2�Y2�]2�^2�a2�c2�g24j2k2�l2:m2�n2o2z2]z2@{23}2Ɂ2��2�2��2��2�2�2�2;�2��2ڭ2��2?�2ڸ2��2#�2h�2��2�2S�2C�25�2h�2|�2��2_�2�23�2u�2f�2�2z�2��2��2s�2��2��2��2�3�3�3�3�3	3�	3�3�3�.3�43Y53t73�93�93�<3/=3zB3fD3E3L3�L3?N3�O3�S3�T3U33W3�u3�{3��3J�3��3>�3��3��3�3��3@�3��3#�39�3ח37�3��3��3[�3&�3�3�3m�3V�3¹3�+6�-660616�26�36�4666�76`8696�96�;6 <6�<6�>6�?6A6C6�C6Cc6�e6�e6�h6#l64r6�r63|6Z�6�60�6>�6L�6�6ڑ6�6"�6r�6С6Ģ6��6�6i�6&�6��6ɩ6��6��6��6�6�63�6Z�6�77(7%7�77�7z7�77� 7�"7g&7�&7/(7�)7�*7,7.7I.7�.7</747�4757)57�87S97�<78>7C7~C7�C7fD7�M7LS7xS7JT7�T7W7bX7�X7[7_73`7�`7�a7�c7�p7_�7��7��7�7τ7$�7m�7?�7_�7��7�7~�7Z�7��7-�7V�7��7(�7Z�7��7��7��7e�7��7�7|�7A88=8�>8mF8nK8�M8uP8^S8U8�W8%X8ZX8�X8kd8gt8v8�v8}8E~83�8��8N�88�8��8ڦ8a�8��8ĩ8��8��82�8ޯ8��8��8"�8p�8�8o�8��8~�8x�8��8��8��8��8��8��8K�8��8J�88�8��8��8��8�83�8��8�8<�8x�8�8)�8��8��8r�8�9)9) 9t%9�%9�-9gN9\O9�Q9qR9fU9�U9g^9m9�o9�p9�9�9y�9$�9��9��9C�9�9�9��9�9m�9d�9��9�91�9V�9'�9!�9t�9��9��9�9��9��9t�9�9~�9P�9��9�9��93�9��9:�9f�96�9��9��9g�9��9 �9�::�:�:�:: :�:h::K:�:�:�:! :j :!:�!:�':+:�-:�-: 0:�@:�A:B:yC:.H:�H:I:�J:�J:L:�L:N:�N:�Q:�Q:R:�S:�V:�W:�^:Ha:ya:�a:��:��:(�:1�:A�:��:��:I�:��:��:Ҩ:�:٬:D�:��:X�:��:�:��:��:3�:z�:��:��:��:1�:Y�:��:��:u�:>;�	;�;*);s);�);E*;�*;�,;�.;�.;o0;06;�6;�6;3:;m:;�<;�>;�@;E;#F;XI;(J;�J;�N;�N;�V;�W;�Z;�^;;i;�i;�i;�k;�l;�l;zn;2q;��;��;T�;��;]�;5�;��;_�;�;��;�;�;r�;63�;��;o�;(�;I�;i�;��;>�;��;$�;q�;��;��;64�;#�;j�;��;@�;�;��;��;�;L�;q�;-�;��;��;g<�<<C<I<�<<�<V<� <�!<7"<�$<.%<�'<�'<�)<h,<�,<�5<@7<�7<�7<�8<M<<=<n=<�=<-H<�N<�O<�P<�P<�Q<�T< U<�a<Eb<�b<�c<�d<f<Em<]m<�p</s<�s<Mv<w<�x<wy<�{<�|<Y}<�}<65�<�<X�<��<�<��<c�<�<7�<Ӵ<l�<��<U�<X�<��<��<�<��<S�<��<c�<��<J�<��<��<��<��<��<�<��<n�<��<��<��<a�<|�<s�<>�<*�<��<��<��<��<��<2�<��<�<r�<��<I�<��</�<H�<4=v=!=�=�=�.=)/=�/=�0=9=w;=A=�A=�A=iJ=�P=Z[=�[=�\=(]=;]=@^=�^=2`=�k=�k=tl=qn=�p=}s=�w=��=��=d�=��=g�=��=ٖ=q�=ś=ܞ=C�=k�=k�=�=��=+�=5�=��=ů=��=ϰ=X�=~�=J�=y�=��=ֺ=o�=��=7�=�=Q�=<�=��=�=��=��=C�=�=d�=/�=��=��=h�=
�=;�=i�=v�=��=�=F�=��=��=��=�=��=��=��=s�=��=��=B�=��=��=1>�>�66>S>�>�>Z>d>�>k >�!>�!>�&>q,>�.>)0>T0>-E>�E>nF>�I>�J>1M>�N>,P>WP>X>vY>uZ>�[>%`>8e>�e>[f>|j>�k>�l>Gm>�m>t>[t>�z>t{>;|>+~>w~>��>֍>O�>ˏ>n�>ʐ>y�>��>�>��>��>n�>��>