Team Ai
Datasetpublic

verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.

sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
stack-v2-Java_00074_00000_shuffled.ds.index47 linesDownload Raw Back to root
1R�Y�)��	V�;m��\(� �!m#$&�'')yw��7�ߓ9����w�%���s�����_�����;���_�C�0���z�����	�;�o����������V�3�h��������K�	�23q
P��~�> n!B#c$�%T&V)W�W�WEXRZZ�Z�]^P_�`|bmceQe�fRhhiNl�lFo�qrusv�{|}E}�~ځ���&�{�G�Ē����̗j�4�������K�r�3�Ǧ5�����f����7�r����n����Nz4�C)K��4�#x&�(�(,*1e1�`�bZcps�vw�ܿW���>�/���º�������~��������������/e�	F�c�\Mfm.q�q�����Q����� �����j�����Ң2������(�����������	>	)5	p	�	�	"
	#		�*	
4	�5	j6	~6	!7	8	&9	�9	>	?	?	q@	�A	B	JB	lC	nO	�P	�Q	�R	tS	�U	Y	m]	^	O^	`	�`	�b	`c	�c	d	�g	�j	@k	�k	Av	Qw	�x	�y	I�	��	P�	[�	��	4�	*�	/�	z�	%�	]�	��	j�	�	v�	��	��	��	�	U�	O�	d�	��	s�	[�	b�	��	D�	R�	�	��	��	=�	��	��	7�	3�	�	^�	q�	h6�7&8�9\10611�12�13�	14�
1516�17�$18�%19z+20,21�-22�R23�a24��%��9�w���%1�25�b����jE!�!�"�0Z78�_�_�b[e�e�f'h�jjo�omu�u�v�w�{�}��<�G��W�����"��4�N���֟R�����d�y�N�d���1�V�^�$�d�!�*�����k������f���L���9�X�#����7�������1���+�������V
w
vs���/��q��"e$=&�&�)r*�*�+�/1�1L2�3�E$MSZ�\}_La�bSc�foi�k>l	nin�p�rs�s�t�vRwry�|c~8�j��������i�T���R�b���˒��ԓZ�ߥ�����٬U�ͱ[���a�һn�,�������D������������@����-�X�S�����2�_����X'0()f+�+7�8V9�9�:�EvG�`1b>dfh�hj�j26m�mUn�r=t�utv�v�w�x�zT|�|}>~�~�~Y������a�����m���G�B�͡��3�ٸ�˹G�л��I���������W���ܳ*�f���o���ܿ����������
�����-����w�u��`�4�P�����'��g�O�s�g��$�F���@���P1�2FI�J4K�KpL4OHP�S?T�V~WtX,^&`a7agsg-nNn7p�p�p4vyz�z9{�����4�F�|���@��ǟ�k���"�#��5�0�p�{�������g���<���~�u���)���.�X����|���h�l�������7����������}��!"x%)[)�)�*:+j.0�1�2�7�9U:�:i;3=/@oK�KsM�RS�U�V^W�m�n/o]pq��p�܂K����[�l����{����"�{���O���*�������������8���x�f���9�{����"�k������tM#�b�9���	����"S#$%�'�(�+,,.z.b b�b�de�h~���G�3�n�Q'�).*�,.P.i.1�2�2�34�I7W
X�X�\�~ǀ&���܄g�D��r�З�����M�d�H����������	o27�q	$�23�4$5�6�6�7�8�FfH5I{K3N�O�Tc28m�m(nrTxI{������D�n���R�͒ؓI�q�
��g����П��7���¶ڸ޻Q�A���������������x�a�0���6�������	:29?0g�������eu�B �&v)f*_-90�1l2B9:�>�?t@�@xJ�JK/KOnxn����ƛ	��"�ܧ&�ީO�5����������������"����lq	�	�	�30�31Z�D
SJ�F����!Y"C$d$�%t'W)m)dEF�F�GHMJ�duk�l�m)p�������T�R�O���j��]���,� �����32�X�ʢԤH�Ħx�d�ӯ5�f���V�6�v�ͺ(�q���
���������,���a�4�������C���g���33�3�W���n�������������^�W�������|�@�6���5�g������=E		V"b%�&Y*�06p8�:|?VAdF�G�KTL5N�N�O"S�S|T>WXMYt\�oYt�t�vx�|34~E���Չ�c�������;��g�Ť���ȱ�����=��������������'���Q�q�'���������e������)�����
 X���f!"�(M01M2�3&4�;�>�?@�NODS�T�U�U�VwW,\c�m�psas�xz~����D����O�������J�����G������8�,���5�����T�����}�s����I������ d#�#�%[&s3I4�9,H�L3O�O�RV`V�V�`Mbxt�v~w x<z�}�~�x���%���Δ!�c������	���֝�������s�F���B���������= � � � G �  � � � 35 Q   � � R$ �% & �& �& �' "2 �2 �4 �7 �= X> �F sG �G sH �H =J �J �K �O �P <T �V �X �Z �Z O[ �[ �a 'c f �j �n �n �t x _y �z �z "� 8� � r� �� ݉ �� A� y� ˞ �� 9� � ת � 5� �� � �� j� C� �� �� J� g� �� /� z� �� � � �� �� c� �� �� � :� �� �!0!�!36!!�!C!�!4!q!!�!!D$!y$!�.!�1!�1!12!u2!�2!�3!]9!:!�C!�D!�F!]K!�K!?N!�N!�U!![!]\!�\!�^!qa!zb!�f!h!pt!pu!�u!y!z!l�!��!ك!߄!̆!��!Ǡ!��!��!��!�!A�!��!�!��!8�!��!@�!��!�!5�!��!�!A�!]�!��!t�!��!
�!j�!!�!.�!��!^�!��!H�!��!J�!��!�!��!��!�!�!"�!�!��![�!}�!E�!"H"
"�
"�"B"b")`"c"�c"d"+e"�h"3j"�j"�k"l"p"�s"��"��"M�"�"�"��"��"-�"�"��"�"��"�"j�"'�"&�">�"p�"ޤ"2�"�"*�"��"�"��"��"��"�"��"1�"$�"��"��"��"��"��"?�"a�"��"7#�.#�/##�#v�#j�#�#Ų#|�#=�#^�#��#'�#��#V�#��#~�#d�#�#{�#j�#q�#l�#'�#��#%�#��#t�#��#-�#3�#.�# �#n�#�#��#<�#��#�#Z�#��#�#Z�#}�#��#��#0�#��#��#[�#J�#��#$$�$d$�$|$�$p$�$R$�$�$�$b$�$f$� $�6$/K$�K$lL$M$,R$V$�V$LX$�Y$�a$�f$Jh$`r$Rt$hx$y$ |$z}$��$��$��$j�$��$�$�$L�$ƙ$��$�$��$��$B�$u�$��$<�$Ů$3�$�$��$k�$h�$��$��$o�$��$X�$g�$��$��$L�$?�$��$��$��$��$��$��$��$Q�$��$��$�$~%�%^	%�37%L%$%G%�%%�%%|%.%�%%|%�%�%7!%�#%�)%�)%�*%g,%�,%&.%^.%�/%�>%�?%A%�B%�B%�C%*H%sH%+J%�L%�L%�N%P%�P%tQ%FR%�R%,W%#Y%�Z%.\%�]%�_%,`%�a%Ue%�g%k%Qk%�k%>l%sm%�o%p%6q%hr%{%��%��%��%͏%c�%�%<�%�%	�%��%��%��%w�%�%��%�%��%��%�%&!&�!&�#&�&&'&z*&~+&�,&�,&-&a-&r-&q.&�1&�=&�>&�H&2K& N&�P&�U&IY&�Z&�[&+\&�p&&t&u&7v&l}&�&�&҂&̉&d�&��&e�&�&��&z�&j�&Đ&F�&��&o�&��&e�&{�&�&�&{�&��&��&<�&�&�&��&z�&*�&��&�&��&��&��&��&��&��&G�&@�&��&�&6�&��&��&T�&l�&�&��&'�&��&��&��&��&J�&��&y�&��&��&��&L�&c�&��&E�&��&~�&M�&s�&I�&��&��&��&��&&'�'.'�'_'$'q'�'g'A'�'�'+ 'G$'(&',('�-'�-'�/'�1'�1'2'�5'�7'Z8'�:'�;'SG'�G'J'<K'�M'dO'4P'�P'�Z')]'�d'�d'�f'�j'�u'�'��'!�'w�'��'��'��'��'��'��'��'��']�'��'�('((�	(�(
(A
(�)(�-(�0(p<(�<(�>(�@((B(}Z(�(k�(Տ(�(ޒ([�(ؔ(&�(��(��(��(u�(S�(Y�(ʟ(�(N�(��(i�(��(Х(^�(-�(c�(��(@�(��(:�(W�(�(��(��(�(V�(�(6�(Z�(��(P�(��(��('�(Q�(u�(��(C�(��(��(�))�)0)c)�	)�)�)�)�)>)�)O)>))�+)�,)-)�-)�.)/)C0)f5)n6)�8)?9)/:)Z;)@)A)�A)�B)=C)4D)}E)�E)RF)5G)`G)�H)mJ)�J)HK)�X)FZ)�[)"\)�\)�])
^)7_)	a)Gc)�c)3g)�g)8i)�i)�m)�t)=u)#w)�x)�y)G{)�})�)�)z�)�)	�)��)��)#�)!�){�)Ħ)�)
�)}�)�)�)~�)�)v�)��)i�)��)��)��)��)=�)��)q�)��)��)&�)��)��)��)��)��)�)�)��)��)��)��)��)��)��)��)�)��)��)W�)��)��)��)�*H*�*S	*�*�*k*�*d**]*� *�"*�)*-*80*r7*�?*?@*b@*�@*SA*9D*�F*H*<H*HQ*T*Z[*q[*��*�*!�*Í*I�*p�*�*�*{�*�*�*�*��*ڥ*��*�*f�*��*��*`�*{�*��*m�*\�*�*y�*��*�*��*�*9�*<�*L++7+�+~++[++m+�+?!+A-+.+�.+`1+�6+�:+�A+�B+EC+D+uD+�O+�Q+�Q+�R+�R+�S+�U+��+��+	�+8�+��+��+׫+\�+��+8�+?�+��+�+��+j�+��+��+�+��+�+4�+(�+\�+_�+��+��+c�+V�+��+��+B�+��+��+C�+��+��+J�+��+��+��+�+��+��+a�+;,y,,�,,t,,,q$,�$,R%,F-,388,�>,j?,�?,�@,A,fA,K,&L,fL,�M,�N,�O,OP,�P,Q,Vf,0g,�g,lh,ii,Lj,��,�,ԝ,G�, �,2�,¡,�,��,O�,��,=�,�,a�,;�,��,A�,۵,k�,ѹ,Y�,��,��,B�,��,��,��,��,��,��,��,��,6�,u�,5�,��,J�,--D-m-A-�-H.�.v.�.�.�....� .?).*.4+.�,.�-.�-.�6.7.�<.�@.39A.C.�D.�E.H./R.�R.�S.T.;T.�Z.�[.�[.5\.a].0^.�f.�.k�.�.#�.�.(�.��.�.��.k�.��.��.3�.��.��.S�.8�.��.��.��.C�.��.�.��.��.��.m�.��.&�.��.��.Z�.��.��.b�.��.��.
�.\�.��.;�.��.��.�/-/�/2 /� /�!/2'/<(/�)/�-/�0/6/8/�</�=/!>/�?/�B/�P/YT/�U/EX/�X/0b/�b/�e/'n/jn/40r/jr/�u/<{/҃/w�/��/��/'�/h�/��/ݣ/��/�/��/f�//�/��/��/��/A�/Y�/O�/��/��/-�/��/��/]�/:�/��/�/��/�/�/�/L�/v�/z�/�00L0�0�00W00'0� 0�!0�(0�30l40�70h9041?0�@0mC0�C0D0�F0;N0xN0uO0�O0JP0�P0�R0S0�S0V0�X0�Z0$[0^\0�]0^0�`0Bd0�d0^{0W}0�0w�0��0�0��0�0�0��0)�0��0_1f	1.1V1�1�11~1�11x1�1J1�1|1/ 1{"17*1:,1�-1y01�11v21<:1�<1f?1�C1�D1OE1�E1�F1�G1�I1�I1bb1�b1�b1i1�i1�j16�1��1�1��1�1�1ˢ1Ȥ1��1̬1�1�1²1��1��10�1,�1��1N�1n�1g�1"�1M�1��1k2�2422282H2=2b"2�&28*2b32B@2�@2NA26D2&F2�H2M2=R2oR2�R2pU2�\2]2p`2c2ec2�d2�e2�g2�j2�j2fk2�k2Kl2ym2n2bn28p28w2u�2P�2��2"�2G�24�2��2g�2��2��2�2�2�2�	3433344363�
3�3�3�3�3=3W33�36!3="3|&3�.3�13�23�P3�R3�S3�W3�\3]3w]3�`3�a3`b3�o3��3ˎ3�3ғ3�3C�3ʟ3׮3��3װ3:�3ɱ3��3X�3׳32�31�3��3Ӷ3@�3�3��3��3��3��3�3N�3y�3g�3��3��345�3��30�3I�3}�3��3��3��3_�3c�3��3 �3��3��3%�3��34�4�4s414L4E4�4R,4/.4f.4�94�94]=4xA4�B4'O4�P4�P4zQ4�R4�U4^W4�q4Qr4t42t4�t4#u4�u4�w4�z4�z4�4Δ4��4�4Š4��4?�4��4+�4Ȩ4J�4��4��4��4}�4��4U�4��4��4��4��4��4��4��4��4j�4z�4��4U�4��4a�4!�4�45�595�505�	5�465�5�5U5�5�"5#5@#5F$5@,55/5R05|0515�354565�65�95<5�=5`C5UG5�H59M5�N5P5jP5*R59S5�S5U5�V5g5	k5�k5�|5�~5�5E�5��5��5]�5y�5��5��5��5ؙ5!�5!�5h�5��5��58�5��5��5i�5b�5X�5�5��5(�5��6�6�6�6t�6��64�6��6K�6,�6��6.�6��6
�6��6��6��6�6t�6�67R7�77�7# 7E!7�%7&7#(7�(7�07I5767=67�~77E7z�7��7E�7��7��7��7
�7�7\�7r�7E�7��7��7��7F�7%�7��7��7��7��7��7��7g�7Դ7*�7Զ7p�7|�7B�7p�7�7/�7_�7F�7��7�7��7�8�
8N8�8�8Q!8�+8�-8�.8#/8�/8�68�68�98e:8�<8�=8?8�?8A8�A8UB8�C8iG8�G8�H8�I8P8R8KR8�S8T8�X8�Z8�\8d8Ke8f8f8�f8�8$�8��8r�8��8Ŏ8:�8n�8��8��8X�8Y�8�8Φ8_�8;�8í8��8O�8��8��8D�8�8��8�8��8�899h9�9z9"9�9�9M9�99i9�9�9�99J 9	"9�'9C(9�,9B.9�09�09\19E69�89�?9�A9P9T9�U9X9YX9�X9Y9Rd9�h9�j9ck9�l9�m9>n9�n9�9��90�9҇9+�98�9҉9w�9S�9��9�9z�9�9��9��947�9�9O�9G�9��9��9�9^�9��98�9��90�9��9��9��9��9*�9��9��9��9��9k�9_�9��9��9�9��9��9��9��9��9��90�9�9��9��9"�9��97�9�9��9C:�:�:�:�::