Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00075_00000_shuffled.ds.index26 linesDownload Raw Back to root
1���+�V	�#I�R+�!�%@&�&n-V.N/e6�7�:�:�@�B�C�D!F�FSK4L�Q^TKh�h�h%i�j�m6oFp�p�pBq�q�r�v�xyH�m�DŽŅ����Lj�Y���Z�~�9�b� ��1����z���p�^4��$=�B$E~EK<PV�WCY�YZ@]�_abg:sas�sc�����2�|�������T�"�#���r���A������,������X�E�>���?���R������N���y��������������^�y���3��9�L�)	�����{g k M!C"m#�*+�+�-�.�/R9�9�:2;�=)@�@-B�B�D�UV�Z�Z�_`A�#�:{;�<�LdOyP�Q1RoTCV�V�X+[gi�i��l�r����3���ݜ8��U���a�H���V�������׾R����������l�����s������H����B����5���A��������hCT}�"��	&
��e�5�����g���x�W!"�"�%'�'�()�)I6�@�@uA�������U����,�1���������&���3���w���1���[���@������S�%5�56D8k8:�:�;<�<Gr�s�tou�u؃b�����*�g��Y�.���������L���j��m����Υõs������ν�����}���Q�����'�Y�*�$�������%�O��e���T�s�B��	C�	��	
�	>�	G�	|�	��	��	��	q�	O�	٣	�	��	�	_�	�	��	<�	��	��	�	$�	�	��	��	�	A�	��	!�	J4K5Y6�7y8k%9�\�\x]v_�_9`a`�g�h�hJi|k�s)u�w�xfy�y�z�}�}�u����+���$�v�-�������'���;�,����8�q��U�z�7�r���ɴ10���&�a�L���������	�������{�Y��$�$�$e&2L8�9?�BsDE�G6H�M#N�P�Q�RdU9W�X�Zv]blbc�d�hcjdl�l�oOqs�s�t�t�uDvzÑ��f�p�i����!��Y���t�ί`���x���3�����I�V�`�����|�@���;�`���t�i�������	H��:��N���� �-�.@5�7�7B�B�DZGqI�J�MtNOiO�O�R�S�SLUV�V�W�Y<_`�g�h�j�o�tUv11wzzF|~3~�~<y�����Z�H�t�Ǒ�������)�����.�̞��U�_�O�Ӯ��u������*�l�(�N�������s�7�����������t�W�R�V�]��|�ٴ�����~�"�����)�+�M�R���O������c�����E���x�t�
5&�I�J�KGM^M�N�NOEO�PS�STUBV�W�Y>Z�ZXr����!���ɇA�ɋ,���L�d�E�����4���E����J�s�u�r�}���G� %S���jy� �"�'O(Z.�/1�:7;�;�<%?�?�Q�W�Y�bac�cRdGf�fu�v�vҒ���t�)����ě���V���?�x�}�;����h��b�*�����������������������o�	�	s^�)g�;;�� ;"	):*+R-�3z5 7�7�9�YM\�\ad�eGhqh.o�o/p�p5rQr�x�|y}y~0�����ͅT�����o�ȖL�-������K����-�m���ۨW��J� � �"H(r-U.�2359:o=�?G@�AB1BXBuC�FJMuM�x�{�|�|�}F~m�����6�����NJ�`�I����d��Y���K��8�e����
�s��8��8�&{bIz� � Z>��Ųղ�]���ֿ��$��e����B�����B��r�������
���q�D���O�m������v�x��?��R�RS�SNT?u�u?w�x�xr{�{"�����o���T�������������]���R�[�������N���V�������	����I�w�l��	&12���/4��~&�&'w'T+U,o/*4I9%:3<�E�E����
���b���w�c�����O�����>�d��.�6  � �	 13    � � ^ 5  /! v" B$ l& #' �S U \W �a �i $j %u �v �z g| �� ^� �� "� w� �� ։ @� �� +� T� � &� è R� �� �� �� � ~� e� �� �� � �� 8� � � �� S� +� K� A� .!�!�!!L!�!!�!�!!6!�!!K!�!�!�!U#!>%!&!Q(!�(!})!�)!+!.+!.!a.!�.!41!w1!�3!�4!27!�8!-9!|9!�9!�C!�C!�E!F!`F!�O!LP!�P!�R!�T!�T!�V!�V!�X!�]!�^!7_!L_!�_!`!�`!4a!�a!�a!c!Tc!jc!hd!�g!Mh!?k!�l!�m!�p!��!��!��!"H"%"�"$"?"�""�"D"m"J&"/1">1"K2".6"L9"�;".<"�V"�V"�V"NX"kY"�Z"�[";]"�]"�]"ec"�f"�m"0s"�|"�}"~"~"�~"�"��"ŕ"�"��"�"�"_�"�"˥"&�"U�"��"�"լ"��"K�"��"o�"��"�"��"14�"b�"��"7�"_�"��"?�"0�"I�"3�"��"9�"`�"��".�"��"}�"��"��"C�"2�"��" �"��"t�"O�"d	#O#|#�#�#�#�#�#:#�/#,0#�2#�6#�9#":#�:#n<#�<#�=#�>#b?#�?#~@#FA#�B#�B#D#�E#qI#FJ#�S#�U#EV#�V#�W#X#<[#i[#q_#�e#i#wj#�n#/v#�v#�w#�~#��#G�#�#�#��#Ҏ#�#��#�#P�#ޙ#h�#�#��#&�#^�##�#��#��#֭#��#�#�#Y�#��#V�#�#�#��#��#��#7�#i�#G�#�#I�#��#��#��#�#��#��#��#�#K!$�"$u#$�+$�-$�-$I/$3$�4$�5$G6$I:$!<$0A$�A$WH$I$OI$\K$�P$R$-T$\$�\$�\$�b$�d$ug$6h$�i$/j$Hk$�k$;l$�n$Ep$bq$�r$�r$-t$�t$du$�u$�u$m}$�$�$@�$T�$��$�$5�$�$Dž$1�$̆$��$��$֎$��$Ï$��$v�$dz$s�$��$8�$t�$��$�$��$�$?�$G�$�$^�$0�$�$��$�$o�$��$��$��$I�$��$�.%5/%a0%�1%�5%8%�8%;9%�9%�D%1I%�J%�N%�Q%�T%�T%[c%��%��%��%ު%P�%��%��%A�%j�%��%��%��%�%��%�%�%;�%��%0�%��%��%��%v�%��%15�%��%�%�%��%��%"�%n�%��%8�%��%�%b�%��%��%L�%`&�&�&�&s&�&o&O16&�17&�&N&�&�&�&7&h&q&&(&�(&*&$+&�+&?,&r,&S-&�O&5P&�P&=R&�[&�^&[_&Wb&Cc&�c&,d& f&�f&�h&Mi&�l&x&�x&~z&Q~&�~&8�&Q�&��&��&r�&7�&�&��&��&��&x�&ˍ&V�&��&b�&e�&w�&b�&�&H�&��&��&��&{�&��&�&P�&�&[�&n�&��&�&`�&{�&��&��&�&yZ)�[)�\)�\)])�9*�<*.=* ?*sA*�M*O*?O*�S*mx*�x*Oy*m{*Q|*.}*�*݀*��*��*I�*�*�*g�*��*#�*O�*ϕ*Ԗ*��*��*%�*R�*�*��* �*��*��*Ƴ*�* �*�*Z�*��*ϻ*��*P�*y�*3�*��*�'+-(+v7+�<+F+�W+�W+Z+^+�a+Hg+�g+�g+�l+�q+�s+�t+ w+nw+�w+�|+�~+E�+�+��+ǃ+��+��+T�+y�+��+Ќ+'�+��+�+��+��+h�+ۚ+��+�+]�+��+�+/�+��+Ӥ+�+��+W�+��+ì+��+Э+ݮ+q�+)�+�+�+K�+�+J�+��+ѻ+=�+ֿ+H�+��+��+��+�+��+|�+��+�+X�+��+�+-�+��+K�+!�+��+��+O�+j�+��+x�+3,u,S,�,,,�,�,W,B,� ,*$,�$,�$,',18+,�1,�4,�5,�<,Z=,�=,>,�>,Z?,�B,�C,�L,�M,"O,CO,f,0f,wg,:h,�h,Wi,�i,j,dn,�n,0x,�~,=�,��,��,w�,ȵ,�,��,Z�,��,)�,�,r�,	�,K�,��, �,��,m�,��,3�,��,��,��,�,��,��,��,��,�,|�,��,��,)�,h�,;&-�&-�&-m'-)-,---�/-0-�1-�2-��-ˆ-��-��-�-p�-��-Ŝ-�-��-��-[�-�-`�-��-�-�-��-γ-r�-��--�-��-W�-Y�-��-��-�--�-o�-��-��-�-A�-R�-��-f�-��-�-��-�19.�20.1.n.
..�./.1.u.�.x.�!.�".1$.<(.).Z*.�1.63.�5.�6.�9.�;.�<.Q=.}>.�>.?.�B.�C.�K.�L.KM.zQ.�R.�S.�U.�Y.7Z.�].�`._f.�g.0h.�h.�i.:j.o.]q.js.�w.5y.2.�.�.��.��."�.+�.�.�.�.+�.��.��.H�.X�.A�.��.�.��.��.$�.�//�0/�1/�6/�:/�</�=/�>/�>/
A/�A/C/�C/�C/ID/E/iF/�F/�W/TX/�X/jz/�z/e{/�|/�}/)�/S�//�/��/'�/��/t�/�/l�/ۋ/��/��/{�/��/ʐ/ʖ/w�/��/��/�/›/��/��/ۦ/��/+�/z�/|�/�/��/׹/5�/�/��/��/��/o�/^�/ �/p�/��/��/�0�0[#0�$0�&0�+0,0�,0�,0S-0XE0�E0�M0O0�S0QT0�U0�V0�V0Z[0`0oe0�f0�o0�p05r0w0Ay0�y0�z0�z06{0}{0�{0��0�0͆0��0]�0?�0�0#�0A�0��0��0m�0�0��0{�0J�0:�0��0��0�0��0��00�0i�0��0��0�0��0I1�T1�U1�^1G`1�`1Ca1�a1�j1|m1�w1$�1σ1��1f�1J�1_�1ד1��121�1��1J�1?�1ɠ1��1�1��1F�1^�1�1��1��1C�1.�1F�1��1n�1��1��1�1f�1P�1��1��1d�1��1u�122�22J2�2n2�2�2H22A232� 2� 2� 28!2�"2�#2�&2�'2`,2r.2212~32=42�42�C2�E2JP2�P2�R2%S2�V2�`2�e2f2g2mg2�g2?o2�v2�{2d|2=}2��2��2�2݅2��2��2��2X�2��2��2�2p�2��2,�2V�2��2��2K�2��2��2ͬ2O�2��2��23�2ݶ2�2�2�2P�2�2u�2��2��2R�24
3�
3� 3�#3�#3�(3])3{23<3�<3*>3U>3?3mE3�E3;F3�G3wI3�I3+L3eM3�O33]3�]3�^3�`3�`3oa3�a3�b3d3Hd3[d3b�3c�3J�3��3��3Ў3�3-�3	�3i�3��33�3$�3�3�3H�3#�3K�3��3��3|�3��3��3�4�224�4�4�4�4�%4(4�)4�,484�H4$I4sI4bJ4�J4(K4�K4.M4FN4�N4�N4@O4IO4�Q4�S4�T4ޅ4��4q�4��4��4J�4��4[�4/�4p�4�4]�4��4��4�4u�4_�4%�4e�4�4�4G�4ب4
�4��4�4��4��4M�4�4F�4��4n�4{�4,�4x�4ο4L�4j�4��4$�4~�4��4j�4��4�4�4�4��4J�4�4��4��4��44�4��4��4��4�4��4w�45	5i	5�	5�235�5	5!5�5C5}5$5�5D!5�!5.5/5�Q5�R5�S5U5-X5I_5�_5�c5�d57e5�e5�k5l5�l5m5Fn5�q5+s5�t5nx5y5�z5�z5�}5p�5�5{�5�5~�5�5��5��5�5(�5B�5��5��5u�5��5�p6�r6/s6�s6�t6Du6z6d�6�6
�6͆6��6��6��6=�6��6�6��6P�6v�6�6�6x�6�6{�6o�6G37�37'57�;7�C7M7:N7O7�P7�f7`m7n7vn7�o7�p7r7�t7Qu7"y7z7Ȁ7a�7�7�7�7"�7|�7��7c�7��7�7��7��7��7�7/�7O�7�7��7�7p�7��7t�7a�7�7��7Ȯ7=�7�7�7P�7x�7$�7ȷ7��8:�8��8,�8t�8��8��84,9	/9�29�39M69Q7989<9�<9�B91C9�C9JD9�D9�D9RE9VF9M9�N9�Q96R9�S9V9^X9�Y9[98c9�e9gf9�g9"h9�h9Kj9Hq9�s9t9�x97z9||9�90�9��9,�9f�9��9]�9ԏ9��9��9œ9@�9X�9��9��9��9�98�9��9A�9-u:Au:Sx:Ty:d{:�|:t}:�}::c�:ۈ:��:��:*�:z�:8�:5�:��:��:��:Ʀ:!�:|�:�:y�:��:�:�:��:��:_�:1�:��:X�:��:4�:��:��:��:��:L�:�;�;�;�	;24;�25;L;�;;�
;;K;1 ;##;�%;Q';�-;�/;51;�2;+4;�;;�A;D;�G;�N;<O;>Q;�Q;�Q;CV;�V;dW;�W;�W;�X;�X;H];�^;xa;�a;gl;�l;p;�p;�;3�;��;��;J�;z�;��;d�;�;5�;@�;y�;��;e�;��;<r<3<�	<N<�<�<�<M<<|#<�#<�#<�$<�%<&<,'<)<1<82<D2<�4<�4<�8<�8<�9< :<�=<�O<�P<�R<�T<BV<\<Q\<,]<z]<�b<Ud<�d<%e<�e<Ah<qh<Fi<k<�~<��<ρ<G�<n�<:�<��<^�<֓<��<��<��<o�<��<��<��<ܦ<��<a�<��<�<}�<�<��<)�<�<o�<26�<��<#�<P�<��<�<{�<i�<+�<��<��<�<Z�<��<��<�=�=T=m=	=�=&=�=�=�=4=�=A=�=#=(= =[=� =� =!=$=�5=�7=38=c8=%:=�:=a;=�>=jB=�B=�E=�F=!J=hJ=K=�`=d=7h=�i=pk=�m=�n=�p=eq=,t=u=�u=�u=��=�=`�=@�=3�=t�=c�=��=�=u�=k�=/�=��=��=��=u�=��=��=*�=-�=a�=��=a�=��=�=��=��=1�=��=%�=�>}>[>�>\%>�%>�&>m(>4*>�*>s+>�->&2>H2>93>�3>�5>X6>z6>s7>8>z8>9>;>h?>2@>A>C>D>�D>hT>�T>�X>�X>�Z>�[>�\>�\>�\>�^>�z>>s>��>q�>��>i�>�>�>��>L�>p�>Ǒ>�>ޚ>��>ɟ>�>E�>W�>��>M�>}�>/�>�>*�>.�>q�>��>�>j�>��>��>???}?�?�?�"?�$?.%?e(?�+?�+?2?R3?�3?�4?:?�:?�J?K?�x?y?��?́?ށ?3�?q�?̓?P�?p�?-�?��?j�?�?�?D�?ӕ?̖?��?��?؝?�?��?ť?&�?�?Թ?'�?��?�?P�?��?&�?$�?_�?��?P�?��?�?��?�?`�?��?��?��?��?a�?�?��?��?Q�?��?�?�@E@h@�	@�	@�	@d@C@V@�@�%@R&@�'@�(@�2@m3@]5@o;@�;@{=@�=@9>@D?@(@@�E@�F@�F@�K@%\@"n@kq@Or@�r@/s@�s@�s@
t@�t@Zu@�z@�}@l�@��@W�@X�@d�@��@\�@A�@��@$�@��@4�@��@��@_�@k�@�@��@U�@��@��@o�@��@`�@��@��@��@:�@:�@��@�
A�AA�A�AN#A�$AcKA�LAEMA OARQA�QA�TA#gA�gA^hAiA]lA�lAsnAoA�qA}rA�sA!tA�tA/wASwA�wALxAh~Ax~A;As�A��A��A��A�A݈A7�A��A"�AM�A��A��A��A�A��A��A�A�AO�AU�Af�A��A|�A��Ab�Av�A��A�AB�Aa�A�Am�Ab�A��A�A��Ad�A�A9�A��A8�A��A.�A��AV�A��A��A