Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00113_00000_shuffled.ds.index118 linesDownload Raw Back to root
1p��	�
�l.�.�1"2+6M8�:�A,B�BrD2H�H�HsI�L�N�O,PCS�S�T�\~e�e=fgh�h�h�r�rt�v�x�y�{g�������p�^������g�,��B���#�IJ��J���Ź��@���t�����&�F�w�����=����]�k�r!�!3"h/�/�1f34�4�5Jil�m/}�}�������ڂޅ��ю���������u��q�����9�ͮX�$�4��5��,6���4E�nm �  "�"D$�+�@�ABfC�FGAGoJSy�y|�~n���_����݇j���ȉ<�^�c���b����-�����<�ռ(�����#�t���p�}���q�4�������������D�B�j��	��	z�	��	7�	(�	R�	��	��	�	��	?�	c5s6 78�9810�11112�13�14�15�16J17B18a19A!20|)21�*22^B23hM24~R25kS26�S2728V29�W30�[31�]32&^33�^34a`35�`36a37�b38~f3940h41�i42Sl43_q44�s45�s46Dw47#�48U�49��50�51��52��53ʡ54J�55բ56�57m�58]�59̯60�61o�62��63J�64�65��66��67��68^�69i�70G�71[�72@�73��74_�75w�76��77^�78@�79��80��81:�82��83�84�85��86V�87G�88��89��90��91�92��93e�94��95�l)j�!=!�!*%�%*&(s(�);/�2V6#8<X<=�@)ALC�C�E96FzF�GHeKqM�M4S�S�S�TUCU�U?WcX�XBY}Y=^�b.cDc�cddtdf�f�f�k�q yi{�{$}�}?�E��R�g�D��ߓ�����"�W���=������ڡѤק�`�%���!�I���������O�"�H��u���H�����|�����k�1�����y��y��)&�&*�*U+�,�17d;�=NB�C�D)F{FGKG�M7N�Q SJS,oI|��2�P��A��؋U�����f���9���G����@����H�ͻ��+�`���j�����$����t�����X�;���������������y�u�������+
{
�
97
�
�
J
,	
�	
f98
�99
�
e

�
=
�
P
�
�
C
�C
zD
�D
QE
I
�I
MJ
K
�L
hN
yN
�N
9P
�R
LW
#X
�X
/Y
3Z
n^
E_
�d
�d
Sh
�h
i
�n
�n
�o
Fr
�{
=~
�
��
B�
��
ɂ
F�
��
Ѓ
,�
��
:�
Q�
��
��
��
��
�
��
�
g�
ʯ
��
M�
��
�
Ǽ
ݽ
�
��
f�
�
B�
�A�WXZ\m\�a�b�d0j�������W���y���~�O����b����������[���#�����v���������r�X�(���2���%�����R�Ilh.��W100�101������l��p p60JGK�LIN!UG[-�Ŏ��5�������?�#�����0�t�����\���l�������R����R���w�h�g�����V�b	102�H�S�\�M �"{(�(�L'NMX�\O^k^-c�d3hih�k�l�n�qzs:vx�x�~����Ã9�:��P�����T���C�������U����i��Z�?�������L�(�Q��������=�����<q��	/
�
�
��G�FG�Gfof�knq�rs�yW~�h�������@��X���5���ģ��>�������	�ж~�����l���y���ؽw���7�����%���b���;�V�������~���)���"�	103�'b+�+l,^2�3�C�EsN�N9R�R�V�]�]rf	h�i�ijm}n;q�u��ԅ����(�Ҍ���X��������������{���դH�ߦ���d�����.�g�D�p�Թ��ǻ�{���]��������������l�K���y��t�P��#�j���r�P�O�4������<����	%������N
��4O�$q%t&C'z(f*�12�246�7�8�9�:�:Y;qFxW�]�]�^b�b*d{e.g�g�lmn�y2|�|�104�/�\�z�(�ݢ�����i���_�ٯ9�ǰ�������(���-�n�Y�z����Q�����K�=�1���g��������P����J���*�Q������?���4�8������H����J	�	�	|105�^�
W����T�$���?� �:+.�0�5�7(<�<�> ?N@RAE�R�UV�W�[h]�`@a2c,d�e�f�g4h r�r�s	t;z�zv����������s�)�����0����� �c�����z�]���"�$�V�	��<��1	5�5�:BD;D�DKM�QHU�XTZ�_@`�`�`�`&fgAw�w�y"{�|A�*�j�u������׎,�M�����Z������6���"�ĥ��������ͮ����:�Q������T�9���2�~�]��Z�?�����9���RI�+�5��106��z�
�4�<K}� � ]!�#)I)*�/0�0U1�4.5�68BBC�H�H�I�I�I�Wde�e�f_g�l�mMnoq_��7�·�����l�y���a�{����:�0���I���֮C��/����g���K�������~���'����������/���0���?���107��L"�&)'#(M(/)�+G,2G3w4H6Y7>A�A�A�A�BND�D�N�PpQgReV
[�[�_`a�r�t�u�v�{�{�|�|�~`�ԏ�3�̓8�4���������I����������X�|�������7�����9�X���!�y�E�u����2��8���p�%���.��	�108�109�K����F!c%�%�%�'#(�*-/�5�S_�`�a�fgRg�g�wx>x�xD�#�,�q�����΅@�����������=���
��H������/�����d�ݹ���I�z�L���J���;���&�ԛ}�0�;�����5�������������&�<�ER�R�R�T�YnZ7c�c�d�fh�o�oKp�p[rtTt�v	wJwjx�xty�{�|M~��_�ύ^���4�ː����П�נU�]�1��w������������λ�����<����:�b���:�l�R�������m����� [   C [ h � o � � +  �" �$ .& �& N' �) q5 ;7 U9 ; �O �W X |Y QZ �Z �] D^ ra Np q �q �r ?s ss '| h| � � r� � =� � � ߓ m� �� �� �� I� $� b� � [� �� (� �� %� �� 1� �� a� �� H� \� �� �� �� �� �� S� �� �� r� �� ��  � �� "� i� �� $� �� �!a!�!�!'!i	!110!�#��#8�#c�#z�#;�#��#��#/�#��#f�#"�#T�#:�#��#b�#�#��#�#y�#��#��#�#��#��#��#9�#u�#��#6�#t�#��#l�#�#��#��#!�#8�#�%$(&$�6$�7$B9$m@$�@$hA$BB$oB$�K$��$��$�$��$��$7�$�$S�$o�$k�$��$X�$u�$��$��$�$;�$��$��$��$�$��$��$��$*�$��$�$��$��$��$�%�%O%~%�%�
%%%%%�%�%3%y%�%%L%�%� %!%�!%�"%�%%
(%�(%2-%z.%�.%�.%/%2%97%8%�8%�;%pR%�S%�T%�[%�]%O_%a_%`%_`%zi%n%�n%�r%Xu%~v%�x%Vy%�|%��%��%��%{�%�%R�%ߘ%d�%��%��%�%Ԣ%9�%<�%��%{�%��%�%1�%\�%u�%��%��%�%��%#�%��%��%��%#�%w�%�&�&Q	&�&&	%&9&&�)R�)1�)&�)�) �)��)'�)z*7*�	**�*6*L*�*�***f*y*�*8*�*� *�(*g)*+*�+*L0*�0*�9*N:*s;*�<*�=*�=*A*�B*_E*F*3H*�I*#M*�R*�S*B[*�[*�[*�\*Ea*kb*�c*-e*�q*z*"|*�|*b�*��*�*�*��*y�* �*��*-�*]�*��*p�*t�*d�*D�*��*2�*��*��*y�*D�*��*ϱ*�*��*��*��*/�*y�*��*k�*��*d�*��*L+�+�+++�+�+�+�+�+V&+�4+$6+�9+C+?C+�G+:H+{I+M+�N+�P+�X+�X+>]+�p+�q+fr+�s+\�+Є+,�+ą+ۆ+�+ħ+1�+��+��+�+��+3�+��+C�+��+:�+�+��+�+3�+��+��+��+��+��+J,",�,�,	,�	,�,
,6
,,�,,�,�,�,�,�!,O#,t#,�',�-,�/,�/,44,5,J7,(>,sC,D,�D,��,e�,��,ކ,9�,&�,V�,��,܍,ڏ,��,C�,Փ,��,��,�,�-4-�-d-�-u--F-�-.-%-=-�-Q-9!-�!-$-J&-�&-�'-z)-�)-v*-�+-�+-D0-l0-F1-�3-X5-�5-�;-<-�>-{B-111E-;F-�I-GJ-�Q-=R-S-�T-jU-�U-eW-2m-�n-�p-Nt-=�-�-��-j�-��-��-��-j�-!�-��-U�-��-=�-��-��-�.L.�
.�.M.�.�.".�.y.{!.n).�).K*.%3.r3.�5.8.IB.�B.D.HD.\E.+K.VK.hL.�L.�P.UR.S.�U.GV.�V.�\.�].b_.<b.�e.f.Ii.Rj.sk.o.�q.�.��.��.E�.م.��.l�.D�.��.Ř.��.�.��.��.Ƣ.C�.�.�.��.ڳ.g�.ݴ.��.��.w�.��.�.��.��.�.5�.r�.��.B�.��.�.Y�.�.�.��.��.�.��.)�.��./�/7/112/H/j/�/�
/ /�/�/u/�//k/9/X/p/�/O/!/2!/Z!/�"/i)/#+/L,/t5/�6/�:/</�</,J/�K/�N/;T/�T/)U/�U/QV/�X/�Y/�Z/�[/�\/�\/h^/Q_/�_/6`/a/tb/�b/Zd/�e/�i/�j/4o/F�08�0ʿ0��0{�06�0Z�0��0X�0�0 �0��0
�0E�0��0��0r�1�22�2�2�	2�11322
2]2�2f2�2�2n!2�!2(#2,$2I$2�$2@&2�'2
O2TO2�O2�P2�P2�Q2�a2�b2c2�c2Od2e2�e2f2�i2Bj2.m2�n2Do2�o2�q2�u2:w2�w2?x25y2Rz2j�2��2y�2ϟ2+�2f�2δ2��2(�2��2��2 �2b�2U�2��2I�2��2y�2��2��2,�2��2X�2(�2e�2��2��2~�2��22�2f�2��2=�2?3c3�3�3�3�	31143O3�3�3C3k3�3�3A3P(3|*3�,3).3�.3�03J13�23H:3�:3�;3Y=3/?3A3A3�P3�Y3�Z31\3�\3�^3�b3�b3�c3^d3�f3 h3�h3�k3�p3@t3(x3�z3�{3�{3r}3�3v�36�3Ҍ31�3^�3Ӗ3+�3�3v�3q�3��3Z�3�3޵3��3u�3��3��3��3��3��3��3�3��3��3��3"�3��3��3��3��3u�3��3O�3v�3
�3��3t�3��3��3�3��3o�3��32�3Y�3'4:4~4�4�4�4;44"4'4�4�
44434�4494f4�4�4�4j4k%4'4J+4�+4�,4�,4?-4�-4J/4)24534�64�;4�>4�>4?4k?4�?4�@4�F4�G4�H4bK4�N4�Q4�V4��4��4u�4��4\�4��4��4F�4"�45�4��4��4��4��4��4��4��4R�455z5�5�55�5s5�#5�$5+(5H05P25c35�45�65�85�:5�;5o<5�<5K5�K5�L5�O5pS5UT5�Z5�[5�\5�`5�a5�a5�f5|g5�g5|i5�k5m5mo5�o5Gr5xr5�r5kv5�v5�y5{5�{5�|5�}5�5ך5�5�5H�5լ5��5u�5{�5g�5��5��5?�5��5��5��5i�5X�5��5��5,�5��5�6�6�66666L6�!6�"6'6X)6�)6�-6H/6M16"26R36o36V56r66v96V=6DL6�e6Dh6�h6�h6�i60j6�z6~6�~6$�6I�69�6��6��6��6��6��6Nj6��6f�6��6�6��6��6��6115�6Z�6�6�6��6�6��6_�6ƭ6ڮ6/�6#�6f�6ȼ6`�6Y�6�6|�6U�6��6��6H�6��6M�6��6��6��6��6R�6��6N�6*7"7�7t7�7�7�7�	7�
7�77G7�7R7�7�77 "7b"7�"7%7f&7�&7�'7�(7�)7?87�97Q;7�>7(?7�E7�F7GG7NH7$I7�K7zq7\u7��7��7-�7c�7��7�7��7��7�7��7ã7��7�7��7/�7�7j�7�7��7��7��7��7��7��7o�7��7:�7��7��7�7[�7i�7��7?8�8�8�8p8�8�8�8n 8�#8�%8�'8�)89+8�+8Y-84/8z/8�28}48�68�7811688�88	98PG8�G8NH8II8�I8�J8Q8�Q8R8�U8W8�X8�X8yZ8F_8�_8ta8b8d8]d8�d8qk8l8m8dn8�r8*s8vt8{89{8�{8Z}84�8σ8�8�8N�8��8ʉ8į8r�8(�8L�8�8��8�8~�8�8l�8��8�8��8��8@�8z�8��8��89�8{�8��8=�8��8��8!�8��8��8��8f�8��8/�8��80�84�8��8��8q�8Q�81�8��8��8G�8!99�999�9�9�9�9�99�9J9�9�9�9"91#9&9$&9U(9�(9�-9�-9�09�>92?9S?9�@9B9�D91E9~F9	I9�I9�I9�H:�L:aM:�M: N:�R:9V:X:�Z:�[:�\:]:H]:'n:sn:�o:=p:�q:lv:�w:�x:�{:|:�|:�~::��:��:��: �:�:�:c�:W�:��:{�:͙:��:ɝ:��:<�:B�:ȧ:��:��:ӳ:7�:]�:��:�:?�:��:c�:��:��:��:��:��:��:h�:Y�:H�:��:�:0�:��:��:��:��:��:-;�117;�(;�);*,;7;R7;:;cA;LB;C;�J;K;ZK;(M;uM;�P;WR;�U;�\;�];~^;=_;X_;b; g;�{;�;�;̀;�;�;D�;Q�;G�;(�;��;�;��;��;F�;g�;}�;118�;ʥ;�;��;��;��;�;��;ǹ;i�;��;��;��;�k<Il<�n<Kr<xr<�r<�r<�r<Wt<�u<hx<�x<�y<�y<z<|<!~<T~<<�<A�<��<��<c�<,�<	�<@�<̓<̔<c�<��<��<��<��<�<�<��<��<��<��<��<��<��<'�<m�<��</�<[�<��<��<��<��<�=�=<=7=�=8=�=#=@(=))=�)=�)=`,=�,=.=�2=y3=�6=�7=w:=�:=�;=v@=�A=�B=�D=~E=�G=�I=FJ=�J=hV=�W=�Z=	\=Ha=�a=�g=6i=:j=�l=Dm=n=�o=�p=Pq=�r=�~=X=O�=�=݉=��=Ǎ=}�=|�=H�=��=��=��=ĕ=ߖ=;�=Q�=ܘ=P�=�=�=E�=�=F�=8�=��=֪=x�=0�=�=#�=|�=��=��=��=Ӹ=$�=f�=�=��=��=0�=��=��=b�=5�=/�=��=l�=��=��=��=��=��=#�=Q�=L�=�=