verify-ppt/smollm3-stack-v2-Java
Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.
0610
1� � � � � � \ �i 1j Ok m q Rx 8y �~ ߀ C� B� �� � � � � 7� Y� (� �� � K� � w� �� L� y� �� �� � �� 8� � d� �* \+ - .3 �3 &7 97 A; XE �E F jF 2T oT �V �X Y �Y ~Z �\ �\ Sd �i �{ �{ �� ں �� �� � � � W� �� � ^� =� ��
� �� �� �� t� � _� �� @� �� �� �� k� �� <� �� �� 7� �� %� 7� # � � e � �! �" �" # �# �1 K FK �K �K �L (M aN ~` La �b �g Uh oh �i 0j �j �k Ll m Os �s >u �u �v �w Vy �y �{ �{ <| � � E� �� � R� �� � � �� �� � ~� � <� �� � a� �� s� � \� 0� �� *� �� *� �� "� g� �� �� E� � ?� (� � �� � �� l� r� �� �� ~� �� U� � ! �* �+ �- �. �. 32 4 9 �: �: j< �? B qB �C DD SF �L �T �W �` c xd 3e �j En �n �n 7o �s �s �s �t
u w \w �y �| �} ~ 2 � � r� ߈ S� [� w� l� Q� l� �� �� �� �� � R � � � 0 t# �$ �' �( a) 0 w2 W5 �7 x? �? �A �C E �F �G
M iM �M �� �� @� �� 1� � �� �� Z� z� ڈ ,� ܬ R� � �� ʴ � f� �� �� � �� � � � � � � � Y �M �N �O �P �P .Q �Q �R �^ _ m_ �g ?h �i �j w �y �� k� C� �� 1� 2� 0� Ҕ 3� )� �� �� ;� D� �� d� �� x� �� �� � �� �� y� N� :� ,� J� �� >� �� �� �� ~ � 3 � A � l G B � � |8 �: �> �@ xA �B [C �D �E %G �H �K �T V {X �^ Pa b �c oe f �g Ph �k Bl �{ K~ �� � {� �� �� �� Л �� � ͨ � �� �� ~� � Ҽ X� `� 3� g� R� �� 6� j� �� �� �� �� �� �� Y� V� F� �� � h� �� � O� �� X� �� �� �� �� C� �� S� �� W� �� �� * } F , 3 � � t 6 � $ / � � � � � " S& s& V* �* F, , �/ <3 �3 �3 <5 87 : 5> �@ qA �A �A �C D rH �R 0� � Y� q� k� -� � b� o� � �� ە ʖ b� �� � _� '� s� ˯ � !� f� S� � �� �� o� g� �� t� �� /� �� �� �� �� �� �� �� ,� D� � �� 4� U� �� �� M� [� ;� �� |� *� �� O� � �� � F � 7 � � ' b% �% �T �W LZ [ Cg tg �h �h ?z �� � � �� � ͟ b� b� b � c < � % � � � m& ) ;) �) �* �+ O- j. �/ �0 �5 x6 z7 -8 �; �; y? �A @B C wJ yK �L �M �M FN �N ;T �T �U 8V cV �V �x �y e| �} 8~ <� 4� -� � � (� u� �� S� § �� �� Щ 4� x� ׳ u� �� � 3� 0� �� � (� � �� X� �� �� 8� �� !� �� 0� �� �� �� �� �� R� �� �� s� �4