verify-ppt/smollm3-stack-v2-Java
Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.
0610
14 � � � � � "# �# d, �, �, �1 �7 _8 �8 �8 �9 {: Q 3T �U vW �W �Y �[ �d �g i �i Ul �l �l ہ {� � 2� �� �� �� �� �� � �� ʜ ?� �� Q� �� O� �� Ц U� ;� �� �� � � �� � s� J� �� �� �� �� �� �� 3� �� |� �� )� � F� �� ^� �� �� �� � �� B� � � � � E = � 0 � � s" {# J& k1 �1 5 $8 9 W9 �: }= �= 5@ uA �A G jG �G �O �O �P �Q �R gS x \x z
� O� �� � E� �� � �� �� o� �� B� � 4� q� �� 3� �� t� �� �� �� 6� �� ,� �� � �� @� �� ,� �� �� � w� 5 � ? g4 �5 � k � � = � ( � � �$ ( �( �, c. �2 �2 B4 �5 �9 �9 *; �; �@ �A �D �D �D �E �E XF �G lN �V Kd �e f ^f �s �| x} � $� �� P� � q� �� F� �� � /� �� � .� � g� � � �� �� ˛ p� �� � E� ˣ f� Х �� �� y� �� � �� � �� �� �� +� � �� C� �� E� �� M� �� >� C� �� � �� �� � R 4 c � � S D e! ;" �, �, 0 �6 n7 �E F "H �H ?M ]M N �c �f �g ah u *v �w �{ I| S~ �~ $ � C� ?� Ȇ �� x� Ό
� � �� #� Ƙ � 8� E� <� � �� � � P� S� �� #� �� �� � '� t� �� �� �� � l� g� @� T� �� F 2 " � � j � �� q� :� �� P� F� V� ֤ �� <� (� � �� [� �� _� �� !� �� � : k ( B w � � �* $- �- 8. _0 �5 �6 �N O GP �Q R �S qU �U W �W �W X QX �Y \ 1f �f ai a� Ɯ �� � �� L� l� �� $� � � O� �� 0� p� � � � R� � �� |� �� A� �� �� �� <� =� H� o� �� s� � �� �� I� �� �� � ܣ �� #� Ψ �� w� �� )� p� ɲ �� G� κ �� A� �� �� �� �� �� �� �� � �� �� �� �� � �� �� � � u � � � %6 �7 �
[ A � � ' � i! /# �# S$ & �6 �7 �8 �: lB �B "C dR X }X ` �` �` b �b �c �c �c yg �q r �r Fw �� �� #� � ד =� �� Z� �� X� �� �� ę �� `� W� �� r� P� /� }� �� �� x� 6� �� �� �� �� �� �� �� �� � �� �� �� �� �� �� �� � � �� � 6 � � � � � X C � �# �$ �$ �' ,( * C0 81 �2 24 �4 9: �@ RA B �B LC �R �T IU $b gb �b "c �c �e �f X� � b� k� T� �� 9� �� �� �� �� �� � l � 1 Q& �( �+ �. �. }/ �5 �6 5; |; �< �> �> K@ %A
B �f �f ~n <o �q Dr us �| �~ � 7� s� � �� s� 10� h� G� �� 6� ь � =� R� K� m�
� U� }� p� l� � !� X� 3� 8� �� �� � �� � I� {� �� v� B� �� � 811