verify-ppt/smollm3-stack-v2-Java
Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.
0610
1R � � � � � :
M
�
G u 4 t x � �$ S) �* �+ �- '. �. w x tx ~z B� �� ӆ r� � �� �� .� �� �� �� �� -� F� �� 1� m� � � �� �� � 9� :� �� � ]� �� Z� �� ,� =� �� � �� �� Z� �� �� �� u� � N� � �� g� �� 1 d � 2 � �- / Y0 : �B C �C wG !K �K M �W X 7Z �[ ] n^ �d �e �i ak (p �u V{ �� J� �� \� v� �� � � "� �� �� � c�
� i� �� �� �� �� �� �� /� 9� Q� B� �� '� a� �� *� � � O� s� k � � � 5
I $ �$ O: �: �: �< V= �? �@ dK &Q �R ` �` ^a �a �a :d �e vf �f �i j �l �m �o Tp �p �p �p Yq �q �x {} 3� r� � �� �� � �� �� ]� � ߕ �� �� ؛ H� �� i� �� � U� Ӻ :� �� ǽ z� �� �� �� }� �� � F� �� � �� �� X� �� �� �� �� 8� �� �� � �� �� L� �� � " � � � � K U � � {
� � A : � / � \ 9 " h" �" �# �& �+ �, �, �. �. U0 �M #y | �| }} � ^� C� � B� �� �� �� צ � �� �� d� �� �� o� L� |� �� �� �� �� �� �
� x H �! f' �( �. �/ F0 �3 }9 �> �> �@ �C +E 4F �G H ^K xO �U �\ ;] Ec �d n sn �o \~ ! � Ҁ � r� � |� � O� �� "� g� ̐ B� � K� ɦ �� ˪ o� � ͯ b� Z� � M� �� j� �� D� J� S�
� �� �� f� �� � �� #� �� �� � � � � [ /$ #( 8* 5. �1 �1 �3 �3 �4 5 �5 �6 LQ S �S �T �V cX Y [ �[ �\ ] C] �` $b c �d �e �l =m �t �y } "~ �� _� J� Q� �� �� �� ٔ � �� |� �� N� .� W� � l� �� �� Ⱥ D� ɾ � L� �� `� �� O� 3� S� �� � �� �� �� h� U� y� �� Y� � �� �� B ( � �6 �7 Z � & M � ] � � " �' z2 3 �7 ~8 >9 �; C
D �D �E gG H LJ NN �b :c sc �c Jf �g 8h Hi �j Kk �s ^t �v �w Tx �y z �z <{ E| (} {� � �� \� �� M�# ,�# ��# a�# ^�# !�# ��# ��# �# ��# 6�# Ǽ# U�# ��# d�# u�# �# �# ��# ��# ��# r�# ��# ?�# >�# ��# ��# ��# �# :�# �# .�# '�# ��# &�# ��# �# ��#
3$ ]4$ 7$ �G$ �H$ 5I$ J$ O$ �R$ $U$ HW$ }$ ��$ �$ ��$ ^�$ 8�$ a�$ 0�$ ^�$ "�$ ��$ 1�$ \�$ _�$ #�$ ��$ 8�$ `�$ B�$ _�$ ��$ ��$ (�$ %�$ ��$ m�$ �$ Z�$ ��$ g�$ � % �% �% % N% M% /% {% �% )
% �% *% �% V% �% % �% t% �% =% "!% �!% �!% #% 1% �1% �7% 9% �9% >:% �;% �=% E?% i?% E@% �@% �@% C% �C% �E% �E% �I% �Z% �[% h% �r% ��% c�% D�% !�% e�% �% ��% Ռ% '�% 6�% I�% m�% .�% K�% ��% ��% �% t�% ��% +�% ��% �% [�% ��% c�% O�% ��% ��% n�% ��% ��% 3�% ��% �% ��% ��% ��% 7�% ��% ��% ��% �&