Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00109_00000_shuffled.ds.index117 linesDownload Raw Back to root
158��l2�3��
���l/r04�5E7�8�9B;l<�=�?5BC�I�T�`db�cYf�f�g)jp|�s������H���	���y��d������c�ѳ��7���*�Z�����Q�O������K�������f�����N�D������������&�p����g�����u\d!�!�')�+,�/�142�2_8y=�?s@ED�E�P'R�R?SkT�X�Y�Z\�\bIg�g�jok�|{�,���b����@�p�7�f�u����3�Ƞ-�r�����������w�n����OQP�Q�S&b�bcd�Ƞ$�����e�C�����N��a�����������/�n����B��T	�	_������#q# $�$�&�*)+�+0,t-.1{1�1L4=:�;S<>�@JE��A�����-�����{��d�m�&jv
�oL�� 
!^#2$�%�&)�*�/50�0�02�3�5l7�8�:'>�?�B�F�G�JO�OoT�VW�WEY�\�];_�fg6gpWp�wCy�~&�������Y�������0�U�����W4	�	�	�	�	h	_	�	�	Q	}	�	S 	_#	�%	�&	u'	)	C+	K,	-	D-	H/	�0	�1	�3	F4	26	�6	�7	�=	�?		A	�A	�A	�J	%N	"R	�j	��	��	��	&�	0�	�	~�	��	_�	ū	ӫ	-�	t�	�	c�	��	
�	��	]�	��	k�	~�	 �	��	8�	i�	 �	y�	��	�5�6�789d1011
12e13(14�15�)16K+17+218�=19Y>20/?21�A22�C23tF24BI25�J26K27L28zQ29�R300S31JV32pW33�d34�h35�i36j37{k38�k39�m40qp41v42Cv43�x44I45%�46U�47~�48�49��50T�51b�52��53��54~�55ď56��57R�58��59<�60�61ŗ62˳63W�64��65��66��67��68��69��70��71��72.�73�74M�75�768�77b�78)�797�80��81=�82��83�84[�85�86t�87��88��89�90��91Y�92��93s�94��95��96L�97��98��99��pI�/	�	�	�}���/@7�8,XA_�_�_?`�`�a�cbk�lQo�oIpq/s�szs{.|�|�~�~C�J�����I����'�ǒ6�Q����������������I�����;����G�����gd��x�	100g101�102eR
U��4���]_�eg^h�j�m:p�pastt�t�u�u�w�w[y��
�	�[�����X�p�J�k���=���b�V�ؗ(���������ǜm�b9<�=�@"A�A�C�C-D"EG\I�I�I;L�LM�P�R�SLV�X_Y�]�_�a�b�bFc�dOeKg~gpik�ru\{�|Ŋ,�Ό��@����_�קF���������{���[�S�������d�!���������?�j��O�W�B���t���"�	%103��s�Q�]��g �!k"�"�#l$�$}'�*�-0p0|4�6`78O9�;�<>F�FrI�Zm[;]�^0b�f}h�k��R�������������&�{� ���������8��,A0R1�6=>�>I?�?�B�C8DeE8JtK�OIQeS�T�W�W>XX\a^__`c c�cej�k^m�r�w�w@x!z�|�~u���0���ׄ5���Z�G�����A�K�_�;�S���t�ѽ��E�����R���'�����L���H��������������i�����
f
,Aj�
�FJM�M=O�U�W�[�\w�z߇�_�Ɋ��Y���7��I���+���ϛ����-�����)����?�s�{��� �J��%�t�����G���'�4���G�������!��������������nO?P0U�U�W�W�X?dnd�e�u�v�w�wN|}�_�݋�q#�#�)Q*�1F235X5�6f7�A�Jo�o�p�p6rGs+t�t�utv�w�y�y�zP{�{�|$&�a�����ɏ����e���&���s�&�n�����'� ��B���104���&�<����
0��&2�T� �!'"�"O&>'>)z*�+)./<1q3�5\6�=�=>@>?�?�@CFYI�IvJ�LM�M�P�Q�ST�T�TU/VvW'X[�]�]�`�c�cBdwfRghGq�quv~j�؍T���H�����J�(�����105���b�3�*�u�$���O�������Q����������7�106���'����"�#A&&'�'7N9h9{9�:BG�G�HIJ�Q4S�Slv�w{x�y={m}�����r�…�k�����������l�����*�L����&���G������������3�L��������������&�����	*107�"�*����n=G�GgH�P�Q�S�ST�VW�ZT\o\^�^�_�_taNc6ggi�n�q�q�r�rt�tueu�u�v�w	}y�ƃA�Ѕo�*�͋�� ���y��A5D�DCI�O�Q�R�R�R�^"_�_�b�d�p�Y�σ�Đe�+��9�ʗ�Z����g�ң2�c��A���~��������"���"����r�&�z�$�'���v�����M���"���^�����c1��e]�e���.Q!�!�&�&I,�-�0�0�1�:+=�CD$G�G�I�KaM�P2RwR�RFS�S�T<V�a{d�d�gHh�i�jal�m�mTn�n�r�e�r�����Q�����n���z��+���108A109������e-k`&"A)	+y,�-)0�1�13x3�5�6�8!9'>n?�@�B^C�I+NzN�N/OqOZ{\�^�_=k�u��?����n�э���<�������x�$�������|�`���d�������9��B�CaD�E�I�IN�O�RXT�T$VRV�Z\T]�^�_)dfTh'j�j�n�p\qXrMs�s�vxz�~������z�؉B���J���ݎ����t������U�����çݨ`�G9�9P:T;�;�CuD�J\KuP2SsS	T-U�UVW]�dvm�n�plq#vVv�v]w110xC~��{���Жr��R�R�T�
�-�h�����x�˾?������K���q���3�U�����F�?�,��������U����������]�I���!���������	�	�	��
4X�"hv��&x -!�!A#.+�,�.c6�7�:�:yGCH�J�KM
O�O�O�S�VVe�jIk�k5lWlfm��W�҈X���f���c��������m���������1�n�����J�6���)�D�ɯɲ�&��G������!	!P!�!O!�!z
!�
!�!�!�!�!] !\*!]+!�+!�,!7-!	/!2!�2!3!43!�9!�9!E:!h>!�>!'C!�C!D!�D!E!�E!�F!ZG!�G!�M!�O!�P!+Q!kT!�T!�U!�Y!8Z!LZ!�\!{`!�d!Ue!ki!�i!Uk!~k!�k!ܢ!W�!��!��!J�!8�!z�!��!��!��!Q�!=�!��!&�!��!��!��!��!��!��!��!,"�"�"�""�"9"�"�&"E'"�'"N("P1"�2"�5"�6"�8"�8"9"Q:"�;"<"�<"?"qD"�E"3F"�G">k"�k"�l"�n"�n"hp"�q"�r"!s"�s"Yv"�v"�w"W�"r�"
�"I�"Շ"H�">�"�"8�"��"�"+�"ϔ"!�"��"Ƙ".�"w�",�"x�"ʟ"��"D�"�"f�"ǩ""�"��"4�"�"`�"m�"��"
�"��"з">�"��"��"��"��"�"p�"��"��"}�"Q�"+�"��".#p#�#h##@
#�#�#�#V##�#�##\##�,#R#�U#�V#�V#�Z#[#hd#�t#u#0u#�u#�y#�{#�#n�#7�#U�#�#��#և#l�#�#H�#��#j�#��#]�#�#��#��#g�#4�#.�#?�#��#��#]�#��#M�#~�#S�#��#X�#
�#��#��#'�#�#��#�#9�#�#-�#W�#��#�#��#�#�#d�#��#e�#��#Z�#��#��#��#=�#.�#��#W�#�#��#��#�#&$W$�$$$�$�$` $1!$v!$�"$�"$$$�$$�$$2)$�+$�.$�/$�0$?1$�4$#7$87$�7$!:$�:$>$�A$RD$111G$tG$�G$�H$�K$�K$%M$yN$�P$�Q$R$�Y$�\$�^$,`$w`$a$�a$2e$�g$�g$�h$i$�i$�j$k$~l$�m$�o$*r$�r$s$9�$Ö$��$�$��$�$��$n�$��$A�$7�$u�$N�$Q�$e�$F�$��$��$�$��$��$J�$��$��$K�$��$��$h�$c�$��$G%�%E%�%]%�%n%�%%2%%q%�%;%�% %�#%$%*$%r%%X&%%(%w*%[+%�`%�a%_e%�f%�g%112u%�z%�{%[|%�%ځ%>�%�%�%��%��%�%��%�%֐%k�%Y�%,�%��%C�%��%�%x�%��%	�%D�%̱%4�%��%A&Q&�&�	&9113&Q114&\&>&�&�&)&�*&�4&r<&�=&h>&WE&F&�P&�Q&�R&S&7S&PT&�V&�X&<Y&�Y&[Z&mZ&�\&_&`&�b&�d&6e&�g&�h&�i&�r&`x&�x&�{&�|&��&��&��&��&i�&�&w�&��&��&��&u�&��&:�&��&��&��&��&��&'�'�'�	'�'�'�'�'b'T'#'D$'�$'�('B)'q*'�+'�.'B/'�1'y2'�2'N3'\5'~7'�7'GB'`c'�c'�d'f'�f'�g'�i'�j'/k'v'�v'�{'*~'�~'n'�'a�'d�'��'�'��'ވ'�'p�'?�'Г'|�'N�'��'115�'��':�'h�'ԧ'.�'[�'�'�'�'��'X�'��'��'B�'��'��'e�'b�'`�'w�'�'��'6�'3�'g�'��'(}("
(z
(�
(!()(�('(U(y (� (� (1"(n#(�$(�&(�*(c7(v7(T8(J9(�,g�,y�,֐,��,�,Ò,��,є,5�,:�,��,��,�,��,�,��,G�,��,��,+�,L�,��,k�,;�,��,��,�-�-�-�-�-@--C-g-�-�-�-k-�-�-�-�-�-�-�-�!-�%-�)-�+-�+-�.-c0-Y9-�:-:=-1?-�@-OA-aD-Y-I[-�]-`-�`-�`-�a-~b-�b-}c-�c-ld-�o-[r-w-3x-�y-��-Ԣ-<�-%�-��-t�-�-O�-\�-�-ݸ-��-��-��-7�-G�-8�-�-��-sP.UQ.�W.2[.].�].#^.ab.Ge.Xf.Oh.cj.)k.�n.o.Ho.�z.�z.&{.8}.@�.с.H�.��.@�.��.B�.!�.��.`�.�.��.L�.��.f�.P�.��.@�.��.��.�/i/�//V/�/i"/�#/$$/�$/X%/�%/#(/	*/:+/B://;/</tA/uB/D/I/�N/g_/�`/b/Ac/�i/�j/r/�r/�r/t/�v/�w/A}/�~/�/��/��/σ/z�/4�/��/f�/��/F�/]�/_�/��/��/�/��/��/o�/�/��/�/\�/0�/��/U�/��/��/�/��/�/��/�/C�/��/��/_�/��/��/��/�/#�/��/��/�1160q
0�0�00	0�0�0u0�0�0� 0J"0�#0{&03'06(0�,0I.0;20�50)80�:0�=0g?0�@0�@04A0�A0AB0aQ0^W0�W0rX0{Y0�Z0�_0l`0�61f81�81�8191�91�91J>1�E1VL1�L1kR1KX1m1fo1�q1�q1:w1�w1g{1d~1Ձ1X�1��1�1�1�1]�1�19�1g�1�1��1F�1��1��1)�1v�1��1��1��1�1��1��1Z�1�1��1e�1��1w�1��1;�1m�1��1��1��1�1@�1��1��1�1��1�1��1M�1�2^	2�	2�	2l2?
2�2k2[2�2�2
2�2�2
2N2�21,2w.2�42E62�82d;2[@2�M2�R2T2�V2�W2�Y2�Z2-\24]2=`2Dk2�k2Jl2�p2&q2r2\s2~u2�y2 2��2��2��2ɇ2�24�2i�2V�2��2��2��2��2��2�2s�2��2G�2y�2�2��2)
3�1174�4!4U4�
4�44X4
4[4�4r4�4�44�4y424� 4%4'%4U%4l(4�(4�*4:4�:4O>4\G4(M4�[4^4#b4�b4�b4�b4m4�n4�n4pp4@q4;v4�x4y4�z4�|4j}4�}4�~4Ā4��4�41�4C�4ǃ4��4$�4Z�4��4ة4b�4��4�4�4Ƚ4o�43�4��4��4��4?�4��4�4��4��4�4-�4^�4��4�4E�4��4��4��4��49�4"�4S�4>�4v�4�4��4y�4��4��4�5�5>/515�1525Q2545�45�45�:5�;5�<5=5rD5%F5PG5qH5�H5�I51J5K5�K5@N5�N5O5�O5�Q5R56R5�R5S5GS5�T5�T5&f5�k5�m51s5kv5�v5�w5�w5�x5�{5�{5\|5�|5ф57�5j�5��5�5��5�5|�5��5�5i�5��5N�5��5��5(�5`�5��5�5�5[�5��5��5��5��5E�5��5�5	�5��5R�5��5�6r6�6 6'!6�!6"6'16�16�46�5696;6�;6�;6q?6�B6XF6�Y6�a6kb6�c6�d6^e6@p6�z6}6[}6�~6�6D�6/�6��6H�6e�6��6>�6Q�8��8��8+�8��8��8�8d�80�8E�8\�8�8��8t�8��8=9�9?9t9�9z9W
9�
9�9�9n9K9�9�"9=9�?9c@9�@9	T9nU9�U9nV9cW96h9k9�k9�o9�p9]v9�v9Ew9�x9V{92|9"}9�9�9��9.�9[�9\�9{�9-�9?�9��9^�9��9��9`�9�9Ӝ9��9�9��9��9Q�9۽9�9�9g�9��9P�9H�9�9��9��9��9b�9��9�9v�9��9��9��9_�9�9U�9��9��9��9�9�9w�9f�9��9j:X:�:=:�:_:�	:!:y:N:�:.:B:f:�::�:":":(:S(:!):�):�0:�1:B4:�4:�>:_?:?:B:�G::H:�H:>I:]J:�J:�K:�O:}P:�P:0R:FS:�S:�S:eW:�X:�Y:�`:�`:,a:d:Qe:f:g:�h:�i:Dj:�k:m:�n:p:�q:�r:�:��:^�:��:�:	�:c�:[�:ƞ:g�:�:;�:n�:��:٢:Z�:,�:�:[�:=�:��:�:/�:ȷ:��:$�:Q�:��:0�:��:D�:Q�:��:��:��:L�:�:��:c�:
�:��:��:�;g;�;g;�;�;T;�;� ;y";	#;$;�8;�B;6C;�D;�F;�F;%I;{K;M;kM;RO;�O;sP;�<:<�<�<"<M<�<5<�<w<.<<'<�</<E<O<{6<(7<�7<�;<?<MA<�D<@E<%K<�Q<
T<V<_V<��<q�<�</�<�<U�<��<��</�<��<��<S�<��<D�<��<o�<,�<r�<��<��<��<�=� =�!=q"=$+=�,=6=W6=�?=�@=�C=2F=�G=GH=V=!W=�X=EY=iY=�^=F_=za=-h=�i=m=Km=�m=Zs=�u=y=z=T~=J�=W�=G�=3�=T�=��=�=@�=��=	�=|�={�=
�=��=Z�=b�=0�=��=u�=��=��=d�=N�=<�=�=�W>�W>=Y>[b>�>A�>��>X�>ۄ>��>��>��>��>��>