Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00107_00000_shuffled.ds.index49 linesDownload Raw Back to root
1]���M'�'�'�(��b��l����A����F��a�	���(�����=� ������������������.9/B3�4�56�68�9�9P�P�T�U2V�[&\z]�]a_�_hc2dte�h�nms�s!t�x�s�~�a�������ՏM�������F�y��Z�I�j�n�~��������2�����u�z�~���������-�ؘk�-�ȟ�x���.�H��~��~���C�N�ɼm���߿��H���f���:��������T��
�%����(�i� !Z!)x*�+�,�,�,{-G0�0&3I;G>�?�?�@�AMBfB�C�E�I�O`b�uwy�y�� ��������������)���������ޛӜ~�Ƞҡ�$�M�˧������*�W���C�f����v�J�D�����\�}������C����%�8������Z�f�'&�-�-Y.�.5�5�68:F=:?�@�A�CKDKcM3T�TW_Z�]^}^�^%_k�pPv8w�y{��Ҕ%��Үf�ǹX��&� ��5���+�j�?���0�J	Z4���ks �%n'(�*�+,K0�4�576�6�<8=�=�@�B�D<EpF�G�I[�\�c�e�g\mom#s'vWx��9����χ2�����T�y����:	�@	)I	@M	pN	�P	�S	BT	�]	e_	�`	a	�e	#m	�m	eo	ns	�s	Xw	�{	�|	u~	�~	��	��	��	�	3�	ӆ	R�	�	؋	�	��	^�	Ǝ	��	��	�	ɘ	:�	(�	��	k�	��	˭	)�	�	C�	6�	��	�	D�	��	��	��	!�	��	m�	��	�	��	��	0�	�	15�6x7�8�9�10n11�12�13�14�15161718d19p20�21�&22�'23�+24�,25$�26�27O�28Y�29�30"�31A�32�335�34�*�-\3]4�O8R~S�S8T�YA]�^q�5���F�q���é9���î�E�����m�5�-�j����5�F���������(���������$:�:'�Þ&���-�D����2����+�0�ǪW���T�l�	��h�����t�4���{��������r���~��w�wly�yFɊO���8�g�z�!���ɗp������9�y�ڱ���?���,�����S����������$�6�����*����1�V�w�t���*Y$
!��u���7��35"g&p)�)v+�+�/l2�4�:GlIQP�S�UmV�WOY�[�]�_�`�b#e�h�ij�r�t�t�vx�x�y�z�{0|�~�6�~������������1���ݒѣ����B�����2�3��'���p���:�����m�����[���+����������������~����������X�������o�(	�	a36Dx��De�B��q ""�"O#)M)6*t+�=�=�>�B�B�FJ/K�QOUXW�X�Y'Z�Z�[
\�^c�g�hIj1k'l�m:n�n�q�r.tLt-y_y�yAz�z�z�~�~3�܁�1�����\���D�
���J�x��K�B����ĩ��!�C�~���ɷZ����:����������E������K���+���	!v�
i`�T��'�*H+�+,>.�0�354^:�;=�=;>�>�?C�CHFHJJ�K�MfNO`Q�T�U2V�Z>[�[�bQe�ef!jWj9k�m�n�n,t�tDvbv�s�5���v�ޓQ�e�O�y��i�؟`�|����8�u����������T�B���#�L���Z�3������
���5���{�$�|���i�~o*3m�2~)�-[.�0�638_8�8�8�@:A�BsD�DFKG�HI�I�IrJOlSTlayf�g#p�p9q�q�r�swt:u�uyz�{����Q��ߐ��)�����E������ެ}�H�:�%�8�s�������7�b��K�Q�����y�>���h�	������������K�`��&�>�Ԍ7��y����E��Q���բ!���~��������-�s��`�����E���h����� �]����	��!�$$4�4S5�6�<�=�>�?�L�LMAM3O1�w�ӗʘ��E����N�p�W��ķ��M���h�T������U�!�!i�!�!��!�!��!�!y�!��!м!��!��!��!��!��!W�!��!!�!o�!��!��!|�!��!��!��!4�!��!\�!R�!W�!��!r�!��!8�!o�!H�!��!��!��!��!�"a"""�"�"�"g"�"�"O "z "� "�$"�&"�&"("�("\)"F*"r*"!/"u2"P3"�3"�6"v:"|>"}A"FG"*H"�H"gP"PQ"�Q"R"�R"<S"Z"NZ"�["�`"�`"�a"wc"Bd"�d"/f"�h"Fk"Fx"Vx"�x"Ny"�z"��""�"R�"��"=�"��"g�"��"�`#-h#�j#�k#tl#Bv#�v#w#x#�x#Jy#�y#{#�#j�#��#�#:�#�#��#č#�#.�#��#��#��#D�#��#'�#��#m�#,�#O�#-�#��#p�#��#��#��#=�#��#��#m�#��#��#��#R$�$$�$�$$$W$�$$�$	$$7$$�$$<%$d-$.$�/$�2$�2$7$�7$I8$�8$(`$�`$b$�d$'e$zh$�n$]o$�o$�p$$u$�u$�$Ά$n�$�$�$��$L�$�$Q�$�$S�$��$��$��$�$�$�$J�$��$�$��$�$��$g�$�$�$��$S�$c�$h�$'�$��$,�$��$b�$��$>�$��$��$3�$��$$�$��$U�$H�$��$5%5%�5%v7%�:%�;%5<%�?%SA%+I%�I%yJ%�J%2K%L%sZ%�Z%�^%�_%`%u`%�b%�b%Gd%�d%[h%j%k%37m%�m%�o%jt%~�%�%P�%Y�%�%�%,�%ƭ%ճ%Z�%U�%k�%��%8�%x�%��%�%;�%n�%��%N�%��%��%��%Y�%��%.�%��%��%��%��%9�%��%�%$�%}�%(�%��%��%�&/38&o&�&�&�&&�&&A& &� &�,&0/&�:&�@&�@&B&�D&BH&7I&iK&�K&�K&.L&Cm&q&�t&�&K�&҄&V�&{�&m�&o�&�&�&C�&��&�&^�&-�&�&¦&h�&��&�&R�&2�&ĵ&��&�&�&~�&��&39�&(�&��&�&3�&|�&��&J�&�&E�&�'�''u'�'�''�'`'<'N'�!'~"'!%'�('�]'�^'�_'�`'�`'�a's'=s'lt'Ey'�y','I�'l�'�'0�'ś'��'��'֠'�'��'ޣ'��'k�'	�'R�'P�'C�';�'��'E�'C�'��'ֹ'R�'�'��'��'_�'��'�'�' �'��'��'�'V�'��'��'��'��'��'4�'��'�(-(�(J({(4(�(�	(�40(�(�(\
(�(K(�(=(Q(�(a(�(�(�(�(c((�"(�$(�/(W0(�B(EK(�S(�S(�T(�U(�X(�X(�^(�c(�h(j(�(��(��(Ύ(��(o�(ؔ(�(��(�(��(��(֚(41�(ߩ(g�(O�(��(S�(�(ü(|�(��(��(Z�(\�(<�(U�(��(��(4�(}�(��(��(��(��(��(�(G�(~�(��(��(s�(��(��(�+)�,)�-)2.)d.)�4)�5):)h:)�:)#@)�A)�B)$D)K)bK)�K)�N)sO)�S)�S)�U)�V)�W)<X)�[)7`)db)Lk)�q)�t)�u)\v)�v)3w)�x)�y)t~)�~)�)W�)7�)��)Ɋ)��)�)Ы)�)��)��)��)�)a�)��)��)`�)��)��)��)��)M�)��)��)��)�)t�)��)��)��)t�),�)��)��)��)��)G�)/�)�*{*
*�*�*�	*�42*Y*�*�*y**",*.*+.*?/*O7*;*�=*�?*�B*C*�F*~G*�G*�H*K*�N*;O*.Q*a*�a*{e*�e*?f*wf*�n*�n*$o*�p*=r*[r*�r*!s*/s*u*�u*�w*7y*�z*�*�*`�*�*��*��*~�*u�*��*�*��*��*��*Μ*��*�*M�*ң*�*��*q�*��*�*ҷ*��*��*��*h�*��*��*��*��*9�*~�*��*��*��*&�*��*��*�*p�*/�*��*8�*��*2�*�]+�^+_+r_+/b+�r+ls+�s+�t+[}+�}+ڄ+��+��+�+��+��+�+ٚ+�+��+�+��+&�+P�+��+��+�+�+#�+��+K�+��+a�+G�+��+�+.�+��+��+S�+�2,�4,55,�=,�?,@,W@,�@,�A,,B,dU,AY,�],zk,0�,��,�,e�,�,	�,~�,��,g�,O�,��,#�,Κ,�,)�,�,��,��,̪,a�,	�,l�,v�,�-
-F-�-�-�-&-�&-�'-�*-�+-�--z0-�0-{1-�1-�3-B4-�4-S6-�6-438-4:-7<-�<-)?-(Z-;Z-<[-�\-nk.�o.�p.�v.�w.jy.�{.�|.F}.�~..�.@�.A�.��.��.�.�.�.��.��.Ķ.��.��..�.��.��.��.M�.n�.��.��..�.��.T�.�.D�.��.��.�.m�.I�.��.��.�.��.��.*�.��.��.��.��.��.��.`�.P�.��.�/�//�//�/�/F/H/�/�/�/&/(/')/,/m./e1/�3/�5/M8/n�1.�1��1M�1��1��1�1�1�1H�12�1��1Z�1W�1"�1h�1Z�1��1��1}�1i�1
�1��1��1=�1��1��1)�1(�1�1h�1��1��1��1��1g�1B�1��1:�1T�1�2�2�2� 2�!2}#2�#2$2A$2�%2�%2>&2+2~,2�,2"-2�-2�12(2232]32�42�62�92D<2
A2�B2�E2H2tL2�O2GP2lR2\2�^2a2�a2b2Uc2�g2�i2�j2�j2<l2�q27r2�s2~t2�{2L}2v2p�2À2�23�2.�2ْ2H�2��2��2�2��2h�2�2��2��2�2��2�2#�2T�2��2�2��2>�2��2�2��2@�2��2o�2*�2��2��2<�23�3443J3�33F3�3�393S3�393^ 3�5363�;3�<3{_3`3�b3c3�e3yf3�h3�r3�y3�y3;z3rz3(|3:}3�~3�3‹3��3��3�3��3;�3��3ƒ3q�3<�3�3��3Ĵ3�345�3��3��3��3��3��35�3;�3W�3��3��3�4�4�464�4d4n4�4O4 44�4;414%4� 4�$4�%4�*4n-4P.4�.484�94�94�;4�>43E4�E4�F4eM4N4�N4P4�P4dQ4�b4Vc4�e4�f4�g4h4�n4�x4�y4�z4{4=4�4(�4у4�4@�4��4)�4�4~�4T�4i�4��4ȗ4�42�4��4{�4��4�4�44�4M�4��4˪4��4�4��42d7�e7Lh7&i7�i7)v7y7�}7�7ف7��7ۄ7��7��7��7�7�7��7 �7[�7��7�7`�7��7Φ7��7b�7 �7i�7f�7�7и7U�7~�7<�7��7�7!�7^�7��7�7z�74�7U�7��7��7Z�7\�7��7a�7��7��7��7��7��7��7J�7�7��7��7W�7��7��7��7��7O�7)8�8808�88{8n$8�%8�&8h'8{28�28�68�H8�H8�b8c8�d8$n8�n8uo8p8qp8ks8��8*�8j�86�8�8��8u�8��8c�8x�8��8x�8V�8��8v9�9�9�99�9t469�9�99�9u9?99+9�9�!9�#9�%9�%9�'9�)9*9C*9�+9n,9�.9�/9�79_89�89�99j:9n=9�>9M?9@9K@9�@9�B9�E947K9cK9M9DR9vS9�V9�X9Z9T[9�[9�]9�`9)b9�c9�d9�e9Gf9�f9cg9�h9�i9pj9�k94m9�m9Un9Av9w9�w9Ox9�|9~9'9��9�9D�9��9!�9��9	�9��9R�9��9C�9��9��9��9%�9Ν9�9β9~�9�9��9�9l�9��9�9��9Q�9��9�9��9&�9G�9��9_�9��9?�9	�9��9H�9o�9��9�9��9��9��9��9>�9��9��9Y�9��9��9�9@�9��9v�9d�9��9��9f�9��9��9?�9�9�9�:�::):0:�:d:�:�:7:�:�:> :� :h):-*:�7:"8:�9:�::�<:H=:�=:W>:�R:�S:[V:�V:�Y:�Z:�[:�[:�^:�`:ca:^c:f:<m:#u:|:	�:)�:W�:��:3�:��:ƈ:�:d�:��:��:˦:F�:�:��:��:r�:��:�:��:��:]�:��:��:��:��:�:�:��:��:��:��:E�:��:��:;�:��:��:��:�:F�:��:`�:��:u�:��:]�:\�:T�:&;�;^;;�;�;c;�;;�;;K;�;@;�;�;b;/;S;�;Y;` ;�!;2,;Q8;�8;-9;�@;�B;�C;�G;qI;WM;�M;�M;�O;0P;V|;48~;�~;�~;R�;R�;��;�;��;��;�;��;�;�;B�;��;{�;r�;ܟ;�;?�;�;e�;��;��;�;��;��;z�;��;l�;��;�;K�;O�;>�;��;n�;�;��;G�;v�;P�;>�;�;��;�;��;.�;�<<�<�<b<�<%"<�.<P:<M<�N<SP<|Q<�Q<S<(S<%V<"W<Y<I�<ъ<_�<�<ڎ<��<^�<��<ٓ<�<�<��<��<:�<ϗ<e�<�<D�<C�<:�<g�<��<��<d�<�<,�<ѩ<<�<O�<�<��<�<��<L�<۲<�<x�<��<��<8�<��<�<5�<��<8�<��<��<��<��<u=+=N=�=�=�=�=:=�=�=�=? =q"=�"=�#=�%=,(=\(=(=�)=|+= ,=�,=--=e/=�/=r0=D3=t3='5=6=�D=�U={V=
Z=;\=�\=�d=6e="g=�h=`j=l=u=zu=�w=Fx={=I|=&}=�~=�=چ=�=�=��=��=�=�=w�=�=��=��=v�=Ӱ=�=Z�=g�=��=��=��=��=��=X�=��=9�=��=W�=k�=��=��=6�=n�=��=z�=�=��=��=��=�=-�=��=��=��=��=1�=^�=\>�>s	>�>V
>n>�>H>�>�>q>�>{>=>� >� >�">�">@#>~#>/$>_$>G&>�&>X'>�'>>)>�)>6*>->�->�.>��>�>H�>4�>��>j�>k�>��>'�>p�>49�>��>��>��>��>��>��>'�>��>��>%�>@�>)
??�?�?	?+?]?!?�!?�%?�%?�)?[,?�=?a??A?�A?�E?!G?$I?*J?�M?�O?�P?�P?=R?`Y?�Y?<[?�\?�a?Kb?:d?�f?ph?�i?l?�s?�x?ty?�y?Vz?�z?�?��?��?��?e�?��?v�?S�?7�?��?$�?��?\�?ץ?Y�?�?4�?�?x�?��?F�?�?��?`�?/�?Q�?�P@Q@4S@�S@�T@V@�W@�X@�Y@=\@�s@�t@}x@�x@�y@2�@E�@��@��@A�@��@��@u�@��@��@ʝ@��@��@͡@R�@�@T�@�@C�@��@#�@��@��@��@�@��@�@h�@a�@ �@�@I�@:�@�@e�@��@��@��@G�@�@�@|�@A�A�A�A� A"+A�+A�.A�1A2Aq3A�3A�3Ad6A�6A7A>8A�8Ap;A�<A6CA�CATDAsEA�KA]LA�LA
NANAANA�SA/TA�{A�~A�A�A��A^�A��A1�A��A��A�A�A
�AȘA��A>�A��AG�A��AO�A�A��Af�Ab�A��AX�A��A��A�As�A��A��A��A	�AR�A=�A\�A��A��A��A��A��A��A�AcB�B�BmBz@B�BBCB�DBhGB�GB!IB�IB�PB�QBoRBVB�VB�WB�XB�YB�ZB,C�C�C;
C�
C�C�C�C�CyCtC#C�Cu Cp!C+"Ce"CP$C�$C�%C�'C�(C�)C�*CG-C�-C.Cp2Ch3C'5C�5C�6C$<C�DCQIC�TC�WC0XC\XCZC�`C�`C�aCisCxwC�xC{Cp|C�~CW�Cr�CZ�CP�CώC�CP�C@�C��C��C��C"�C�C��C1�C}�C��Cr�C��C2�CY�C	�C��C��Ce�C��C��C��C}�C0�C��C,�C��C