verify-ppt/smollm3-stack-v2-Java
Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.
0610
1z � o 2 � x � � & � � � �^ _ �h "j =k �k Kl �m �n Uw Wy 0z �z �| �} �~ Ł �� �� �� ,� ݮ �� ް d� #� ǵ a� �� 8� �� T� �� �� �� � d� A� ^� � 2� f� �� �� �� �� !� @� �� � �� �� 6� �� O� ��
~ � f K � � ) W U I � � 6 � : � < v � �! " �% �% �( �4 6 A6 !9 Z9 3? �C PF PG eJ �N �S �Y �Y �Y �Z ,[ m[ w\ ] (^ �^ B_ �_ ia �e �f [g �g �h �� �� Y� x� �� r� g� � � � � � C � � � � � K � � A '! �! �! # 5% �& r' (( �) �/ �/ �3 �9 �= 1G �H iI �I �I �Q �U �V �V �W iY �Z [ �[ I\ �\ �] �^ �_ �f &g qh �h �u w �w x 5x }} �} �} � � J� �� #� �� � [� �� k� /� � � �� �� h� γ �� �� �� =� �� �� � Y� �� ,� :� (� �� +� |� ^� � � i� 1 � ^ � / � } � =# % �& �( �) g- �3 U5 �8 �8 @9 �9 �> �@ EA DB D EE �F �P �P �P S �S �S IT 8[ �[ -] a zt �t ǀ � s� �� u� l� �� �� y� � �� b� s� �� � h� �� 2� � �� �� r� �� �� Y� 4� 5� {� &� � f� �� "� �� �� � (� �� _� � ]� y� 0� �� h � N � M � � � I �! �" x# O) �) �* �/ �0 32 �3 �5 �< �@ SA �A �A �B rC �E IL �N 2Q �R �] A^ �b �c �e Zf ͆ � � ^� �� �� #� �� �� � v� c� �� p� |� �� �� �� � �� �� x� P� i � � � [6 Y M � Z ! �) ;* H* �- . / �/ �2 Z3 6 R8 �9 m: �: �? �D ?F FO �P �P |Q �U OX �y 7z �{ �| .~ ) �� 9� � 1� �� 0� �� �� � R� J� � �� � 6� V� �� D� �� b� 9� �� X� �� � Q� �� �� r� %� � � q! �! �# �% `' �( �4 5 �? M 7N YS Z �Z u[ %d Cg �h �i �l �m n � �� w� �� � �� <� �� �� �� o� �� � �� �� n� h� �� � �� {� �� � d� �� 4� �� i� �� �� �� G� �� f� 2� �� � t� �] +^ r^ �^ �_ �_ �` a >i �i j �j cn �q �s y �{ Q| m� l� �� � � *� �� ٘ �� ~� B� g� �� �� �� 1� �� (� X� L� �� �� �� J� � +� �� ]� �� :� x� �� 9� �� f� |� m� P� �� �� �� *� � v h P � � : 8 �C ?F .I \I K �M mN �O IQ (S DS �T �e f �f fg �g h �j Fp �s �t G{ �� Ƅ x� 4� ߌ r� 0� ȥ ɦ t� ~� �� ��
� 7� h� 7� �� 6� c� E� �� y� � �� �� x� � 8� �� �� �� G� �� �� l� o " � � � � �4 �: �< �= �> �@ �A �H �I 'K �L �h i Ri �x �y { V| R� �� � p� �� ӆ �� ӈ u� Ɋ �� 1� ȑ B� E� י � #� �� <� G� ~� ʹ �� � �� �� �� �� � �� �� {� ~� �� �� 8� =� �� �� V� �� �� �� �� � c� � 8