Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00054_00000_shuffled.ds.index17 linesDownload Raw Back to root
1�rl�	Cf	.
%es�r���!&()b-�-�.@�I�IVJ�J�K!L%MbM�N�NwR�S TIUdUuUf[Q_}`�b-e�e�f�j�k�l�m{pqy�z|S~P]��R����ڌ�Z�u�.���"�9����N�����Y�����\������"���)�N�����ܻ$�A�����N�����}���-�L�����U����L��/�!����/#X$)�2�4�=�?F�F�GdK5L�T�TrV�V�W�XhY�^�_~`-a�c3pgq	t�tkv w�xEy{�~����;�6��)�����s���%� �y�f��¡���;��U�n�z�M�|�Ʒ��f�U�<����T���M
��DH�0 r �!�#>$�'-�-Q6�6�6�7`9�9*@@BC�C�C�Zv`�`a�di�i�j�n�q�qE���[�m�R�����в�m���������������s�?�d�t�:���2�D���M�O�v��J�G��"Y�Tq���M�-��h�'�]�ץ����ɩM���Ů��U���M��ܽn���`�g���x��������H������������g�������G��:�@�MJ�	�E�BJ����hV7@^@�@�AXIrM PQ�R�S�SCZ�Z�\�^�_]b�bd�d�e�fwm�mPn�r�r��ѡ~�{�q�ͮ�y���������f���0�q�K�t����H�����/�����R���@������w�N���(�����]����������d����p���%���Hs�z�-�/P$U�-�/]1�5!7tNkP�Q�R�V�]�^�_̖�=�K������Ӳ�@�������H�4�������n���[��� �����7���b�]���W���m����������������������Q��X	s
%7X&����*�+2,�,-#-<.X.N/]1�1�F+H/KbK�K�L�M�N%O�P�PUQe8e!f@u�v�w�x�{~�Q�j����H�ȏ�~�U�E��͸��2�����,����;��8���9�������{��������=��6�=
 " � N&w&�'�(7*�1�57�7�:�<�>�C�C�DFGqP�R�S�W�X.Y�[�^fh�knq�r�r/t*��t�džc�݈�������������#�М��D\���~�=D@�@�A�B�B6C{D�D�J2KsQ�Q�R�SDTV�ZQ[]^5a�a#i�iTl�m�n�v:w�wbxiy_z�zb����3��Y��;�!�И�y�%�r�����~���q�Q�����9�����0�������D�X����		s	x	�#	
%	^&	9(	�)	�*	u6	�A	�C	�E	�F	tI	�L	qO	�O	�Q	|S	2l	�o	Dr	+t	�|	�|	�}	ؕ	�	��	Û	��	5�	����S�Ǔ)��������V�����I�K�|�������ͼѾ�:�������s���<���������m�����o���G������x��Q�h�����7
�
4

�
,
�
t
�
�
�
� 
&#
&
u&
r'
�*
o+
�.
/
b/
�/
 1
R2
L8
�9
�:
;
�;
�<
�?
@
�@
�A
H
�H
[K
NQ
J^
d_
&`
�b
�h
�h
i
�q
�q
)r
�r
�r
5s
Lu
y
~{
�{
~|
�|
/
�
8�
��
…
|�
��
��
�
T�
��
�
�
S�
��
��
��
6�
f�
��
�
��
��
ƞ
��
Z�
�
��
X�
�
p�
�
5�+�+��+�+F�+��+�+߻+9�+�+4�+��+M�+��+��+��+4,�,k,,�,�,s,�,A,],�,�,9,%,7,�%,\',�3,F5,8,&9,b9,%;,�;,�=,C,�F,CI,�I,�n,�o,�{,C},j},~,Ń,��,܊,(�,ۋ,��,:�,��,��,�,ݯ,�,�,��,v�,}�,��,��, �,�,a�,��,��,��,��,%�,P�,��,-�,�,��,��,��,��,��,�-V-r--�-f-�5-}-�-�-�
--�-�-�-�-�-�-o-0-f-T -!(-+-�=-�>-QA-sN-MO-�X-^-d_-�c-�d-�e-�g-'j-�p-Pq-ur-�s-�P0�P0�Q0��0�0*�0O�0��0-�0�0�0G�0��0Q�0��0)�0��0`�0�0��0g�0��0.�0N�0�0��0��0��0��00�0u�0��0��0Z�0�0Q�0;�0y�0V�0��0I�0\1.I1�I1�L1+N1_N1,O1�P1�Q1	R1%T1:V1�Y1Z1�[1�]1=_1�c1&e1if1�f1�n1�o1�o1�p1&q1�r1z1�{1�1h�1�1��1+�1D�1/�1y�1��1�1��1��1��1,�1'�1��1'�1��1[�1��19�1n�1c�1�1ܫ1��1�1ӯ1o�1�1��1��1��1|�1i�1ƺ1��1׻1��15�1{�1U�16�1d�1�1��1P�1�1��1X�1G�1��1��1��1��1Z�1��1�172e2�2T2�222�2A2�2�2�2�2d2�2� 2I"2�"2�#27'2,2j,2 .2v.2�.2�O2]T2V2�V2	Y2&[2�[2�p2�x2Oy2{2#{2�|2�}2b�2{�2��2Y�2��2��2ތ2J�2��2�2֚2#�2ߝ2�2�2'�2é2�2|�2�21�2H�2��2��2�2B�2�2�2˹2\�2�2��2��2��2]�2��2��2E�2��2)�2��2y3E33�3Q33�3�3�3c"3�"3l&3�&3�&3'3�'3�:3<3�R3�U3�U3GZ3[3�\3^3�_3�`3�`3�`3�k3hl3Hm3Ax3ux3�{3�|3�}3~3�~3��3Ȁ3/�3��3׃3l�3��3ߙ3K�3{�3��3_�3ݞ3�36�3ܦ3��33�3�3q�3�3��3[�3W�3��3��3��3h�3��3W�3>�3��3w�3,�3��38�3�3F�3N�3k�3��3��3��3#�3��3��3�3��3�3��3x�3|4�4�4+4z4
4�
44c4�4P4-p4�q4	v4w4�w4�z4v}4n�4o�4f�4a�4U�4 �4H�4j�4]�4��48�4ȥ4��4�4�4��4��4�4��4׶4v�4͸4]�4)�4g�4��4��4�4�4p�4��4��47�4}�4m�4��4o�4��4��4��4��4N�4��49�435w5�5�5�
5�
5(5W5�5\5�5D5X5@(5�(5$:5�?5O5R5pU5AY5�Z5�[5�]52`5�`5zl5�n5�n5@o5`o55��5��5W�5ʇ5e�5��5	�5�53�5�5��5ޛ5��5��5��5_�5�5��5>�5v-6�56�66�86�:6�:6<6�<6�=6�A6&E6F64G6J6�K6�K6iQ6*X6^Y6C_6�`6�a6�f67g6�h61i6�j6yl6=p6,r6�t6�v6�y6�y6}6�}6��6܁6щ6:�6�6�6@�6ݙ6��6u�6��60�6�6w�6��6�6��6��6�6��6(�6��6=�6��6C�6��66�6��6<�6��65�6��6!�6��67P7?7m7�77�7� 7�%7x*7�*7�,7�,7&-7�.7�/7�27�67C87�87|97�>7�@7aA7<B7zT7�U7~V7�Z7h[7�n7Nr7�r7ct7�u7ex7y{7�|7�}7�}7_7�7A�7�7�7_�7��7��7č7Z�7��7��7��7��7�7X�7��7��7I�7D�7%�7�73�7?�7��7E�8o�8Y�8�8d�8��81�83�8O�8��8��8@�8"�8	�8�8��8�9 9X9i9(9	9�9X99E9�9�9�9�9N9� 9;$9�%9;&9A'9�59�69j:9�:9[;9m;9%=9c=9{>9�>9�B9&D9|D9H9kH9vI9�I9dN9zR9QS9�T9	U9gW9�Y9�j9,o9�o9Or9�9U�9!�9K�9��9��9�9��9�9j�9�9O�9ݬ9A�9�9�9�9��9Q�9Ҵ9˵9m�9�9w�9�9c�9`�9��9��9��9 �9g�9e�9��9 �9��9(�9�9U�9��9x�9��9^�9��9��9O�9��9��9��9�9��9�:�:�:
:K:�:�;:�U:�W:QY:Z:c\:�\:e]:z`:�`:�h:�h:�i:�i:�k:�o:!s:�u:�u:�w:m�:��:��:��:i�:)�:�:	�:ܒ:�:�:X�:��:�:Ġ:��:I�:��:Z�:p�:"�:<�:a�:��:��:��:.�:�:�:`�:�:]�:Q�:S�:�:��:��:O�:��:��:�:��:��:8;�;8;U;;�;�;;S;a(;,;p,;�,;4/;t/;�4;5;�5;n>;�B;C;�H;�J;EQ;�T;�U;aV;�V;�W;\;{a;~b;�i;m;n;|q;St;u;�w;�w;tz;�{;@};B;v�;Y�;��;Յ;��;��;؈;ʊ;�;��;-�;"�;��;��;�;1�;�;��;��;:�;ӟ;Ϡ;1�;��;!�;~�;��;ܩ;�;_�;��;��;Ϳ;4�;��;I�;��;��;M�;��;��;��;P�;��;O�;�<%<�<X<�<�<�<{<<T<u!<�!<B"<�%<&<�'<*<�,<2<82<�2<�3<f4<�4<�G<�H<$I<�M<�O<�P<T<pT<�\<|]<a^<#_<`_<`<�a<Eb<]i<o<�p<Hq<�r<s<yu<v<O}<S�<?�<Å<h�<��<�<q�<$�<�<��<��<�<�<V�<�<̤<#�<��<å<�<�<V�<��<3�<��<�<u�<��<��<�<t�<��<��<�<��<i�<��<�<�<u�<�<=�==?=?A=hD=�L=M=N=(U=�U=PV=X=�X=�Y=i]=u]=�^=za=b=�b=8d=1e=ue=�f=f�=�=�=��=.�=<�=d�=~�=�=;�=��=g�=v�=)�=��=��=��=��=��=z�=+�=F�=��=��=v�=��=>�=��=a�=��=x�=��=�=��=��=H>�>~>�>*>@>b	>~	>�>%>>�>�>�><>�1>E2>)4>�4>�6>;k>�p>�p>r>Kt>v>�w>(x>jx>�>R�>��>��>��>��>'�>��>)�>�?�?<?�?�$?+%?�%?}&?�&?�'?�)?�*?o0?4?�5?�7?�7?�>?E?hE?�F?ZN?�O?�O?�P?@R?kR?7S?�W?3X?[?^?l_?a?�b?d?�d?k?�k?]q?jy??��?}�?S�?Ȏ?O�?!�?r�?�?��?;�?��?K�?�?8@�8@�8@�;@�?@�B@rC@$E@&F@4H@I@M@�M@�O@�P@nQ@�S@T@{T@�U@[@i\@�a@d@�d@f@9h@i@�i@j@&~@�~@�@�@�@]�@�@��@��@�@��@=�@K�@��@T�@�@ǟ@%�@ʡ@e�@��@9�@T�@\�@Ī@�@٬@��@�@��@p�@E�@��@��@�@��@��@�@��@	�@[�@��@4�@��@+�@��@|�@1�@��@��@[�@f�@��@��@5�@�@a�@��@dA1A�A�AMA#
A�A�A�A�A6A�A�A AR A� A�(A10)A+1A�1A4Al4A�9A[:A�;Az<A�AA�CA�MA�QARA4RAWA�WA�WAVZA�[A�\A�]A?_A�_Aw`A�cA7sAl�Ao�A�A��A�AJ�A,�A)�A��A��A�BB�Be5Bm6B�8B.:B�:Bl;B�<B�<B�<B�>B1?B!@BRBWUB�VBFXB�XBo[B�[Bo\BaB\hB�xBzB{zB9|Bo}B��Bi�B�B��B��B��B
�BB�B3�B�Bt�B=�B��Be�Bd�B��B��B �B�Bu�BL�B��B��B�B�B9�B��B-�B�B��B4�B��Bz�B��B��B��B\�B�B��BY�Bm�Bk�B�kCpC�pC}tCwC�wC�zC{C||C!�C��C��C�Cs�C��C?�C��C��C�C��C�C��CL�CS�C_�C?�C3�C��CK�C��C��C��Cy�C�C��C>�C��C��Cw�CD�C~�C�C}�C��C��C~�C��C�C-�C)�Cf�CI�C��C��Cs�C7�Cd�C;D�DzD�D�D"	D�	D�D�D]
D�
D�D?D?D�D�D�D�D6DCD�D�D{DD�&D�+D1,D�.D	0Dx3D46D�HD�JD�KD#OD;QD�QDRDSD�TD�VD:XD�`D%bDYeDflD�lD�nD�oD�pD�qDtD�uDIvD�xD�yDzDL�D]�DW�D��DأD~�D�D��D��D��D��D��D��D7�Dq�D?�D>�Dt�D��D�D��Dh�Df�D��D��DA�D)�D7�D��D|�D��D9E�E(E�ENE�E�!E#E.#E�#E�%E{(E�(Et0E2E�3E�7E�8E;E<E3>Eg>EGEE�FE%HEAMEPEvQEYRE�WE�XE�YE�fE"gE�gEThEchE�nE5pE�pE�pE�tE9vE�vE�{EH|E��E�EY�Eq�E�Ed�E��E�EӖEΗEӜEd�EˡE��E4�El�EӧE��E��E��EݪE�E��EU�E��EV�E�E��E�EY�En�E��E��ES�E��Er�E/�Eo�E��EI�E�E�E�E%�E��E��E��E��E��E�ES�EL�E}�E��EAF�F-F�F/F�F%	F�	F�11FF�,F]-F/F�0F�1F�;F�<FKFF JF�JF�JFPF�PFWRF>TF�]F�^F�eF&fF�gF1jF�jF�jF�kF	nF�pFrF�tF�wF�xF�yFS{F�}F12Fe�F�F�F$�F�F��F��F�F��F,�F��FQ�F�Fx�FϫF(�F`�F��FíFw�F�F�FӿF;�F��F��FX�F��F�F��F�F��F��F��F{�F��Fe�F��F$�F�F�F��F��F��F!�Fi�F��F�F=9G�9G:Gh:G�>G�GG0HGUG�UG�UGCWG�\GUeGeG<gG=iGjGoG+oGpoG�rG�wG�xG�xGWyG�|G�}G�~G�GL�G��G"�G�G��G�Gr�G��G��G"�G�GE�G13�G��GS�G��G�G�GS�G�G@�G��G��GF�G��G�G��GH�HBHcH�H+H�H�H#H"H�H$%H&H�&H 'HL(H�(H)H�*H�+Hq-H&=Hs@H�AH�CH�HH�QH�VH�ZH�sHvHMvH�vHwH�HB�H14�H&�H�H��Hr�HܦH$�H̩HʪH�H��HӬHo�H>�H��Hb�H�HűHC�H��H��H�H��H��H��H��H��Hd�H��Ho�HD�H��H��H?�H��H��H�H�Hu�H��Hn�H��H]I�I'IOI�InI�III�I� IQ&IT*I+I�,I�0I�0Ik;IۼIK�I��I-�I�IK�I��Iz�I��I��Id�I(�Ic�I��Ik�I��I"�Ir�I��IE�I��I15�Ic�I��I��I�J�J�J<J�J�J�J� J�!Jj"J�"J#J&J�&J:J%<J�<J16?J�FJaOJ�OJ#QJ�QJ�RJ,SJzTJUJ&VJ�VJ�uJ�vJSwJ�}J�J\�J��J͉J��JՑJ�J4�J�JN�Jc�J��J��J\�J��J&�JU�J/�J��J��J/�J��J;�J��J��J�J
�J-�J��J|�J��JCK]K�K�K17KQK�KK�K]K�KI"K�"KI#K$KZ$K�$K3%K9&K�&K|*K�+K.K�.K@0K�0K1K2K,4KB5K6K 7K2>K�>K@K_@K�@K�@KFAK�LK�MKyNK�NKkPK�PK_K�dKfKojKclKnKVnKwKa|K�}K߂K�K|�K�K��K�K�KY�K/�K��K�K�K��K��K��K��K��K��Kw�K��K�K`�K%�K��K�K�K��K��K��K�K�L�L�0L4LU8L�8L%:Lh>L)?L�?L/EL�ELFL�HL�HL2KLLL6LLlML�MLSL�SL�TL�TL�UL"VL�XLuYL>�L-�L֛L��Lm�L{�LE�Li�L��LբL��L�LK�Lz�L��L��LƪL2�Lb�LL�L��L��L�Lx�L�LY�L��L��LR�L��L��LW�L-�L��L/�L��L��L'�L>�L��L��L�L��LCM�M�MAM\M�	MM3M�M�
M�M�M# M� M�!M]"Mj"M@%M�*Mg,M�-M�2M�2M"3Md3M�4M�:Mc;M�=M�@M�@MHMlJM�JM�JM�OM�SM�TM�YM�\Mf]M�^M_M�kMBlMLmM�nMfoM[pMqM�qM�qMsM�uM�wM�yM}Mr}M�M��M�M��M��M�MU�M2�MG�Mq�M��MD�M�M�M#�M�M��M��M��M��M��M�MM�Mu�M��M8�M��M�MX�M��M�MH�M�Mn�MN�M��M��M��M��M_�M��M��M�M��Mv�M-�MA�Mi�M��M~�M��M