Datasetpublic
verify-ppt/smollm3-stack-v2-Java

Synthetic Pre-pretraining Datasets This repository contains the pre-processed datasets released with the paper Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior. The datasets cover both pre-pretraining (PPT) tasks and pre-training (PT) mixtures used in the paper. PPT tasks include k-Shuffle Dyck, Set, MP-Struct Core, and NCA; PT mixtures include C4, SmolLM3, Olmo3, Marin, and FineWeb-Edu configurations. The pre-processed data are tokenized and organized by… See the full description on the dataset page: https://huggingface.co/datasets/verify-ppt/smollm3-stack-v2-Java.
sourceHugging Facemitupdated 5d agoView on Hugging Face
0likes610downloads
root.gitattributes
.gitattributes189 linesDownload Raw Back to root
1*.7z filter=lfs diff=lfs merge=lfs -text2*.arrow filter=lfs diff=lfs merge=lfs -text3*.avro filter=lfs diff=lfs merge=lfs -text4*.bin filter=lfs diff=lfs merge=lfs -text5*.bz2 filter=lfs diff=lfs merge=lfs -text6*.ckpt filter=lfs diff=lfs merge=lfs -text7*.ftz filter=lfs diff=lfs merge=lfs -text8*.gz filter=lfs diff=lfs merge=lfs -text9*.h5 filter=lfs diff=lfs merge=lfs -text10*.joblib filter=lfs diff=lfs merge=lfs -text11*.lfs.* filter=lfs diff=lfs merge=lfs -text12*.lz4 filter=lfs diff=lfs merge=lfs -text13*.mds filter=lfs diff=lfs merge=lfs -text14*.mlmodel filter=lfs diff=lfs merge=lfs -text15*.model filter=lfs diff=lfs merge=lfs -text16*.msgpack filter=lfs diff=lfs merge=lfs -text17*.npy filter=lfs diff=lfs merge=lfs -text18*.npz filter=lfs diff=lfs merge=lfs -text19*.onnx filter=lfs diff=lfs merge=lfs -text20*.ot filter=lfs diff=lfs merge=lfs -text21*.parquet filter=lfs diff=lfs merge=lfs -text22*.pb filter=lfs diff=lfs merge=lfs -text23*.pickle filter=lfs diff=lfs merge=lfs -text24*.pkl filter=lfs diff=lfs merge=lfs -text25*.pt filter=lfs diff=lfs merge=lfs -text26*.pth filter=lfs diff=lfs merge=lfs -text27*.rar filter=lfs diff=lfs merge=lfs -text28*.safetensors filter=lfs diff=lfs merge=lfs -text29saved_model/**/* filter=lfs diff=lfs merge=lfs -text30*.tar.* filter=lfs diff=lfs merge=lfs -text31*.tar filter=lfs diff=lfs merge=lfs -text32*.tflite filter=lfs diff=lfs merge=lfs -text33*.tgz filter=lfs diff=lfs merge=lfs -text34*.wasm filter=lfs diff=lfs merge=lfs -text35*.xz filter=lfs diff=lfs merge=lfs -text36*.zip filter=lfs diff=lfs merge=lfs -text37*.zst filter=lfs diff=lfs merge=lfs -text38*tfevents* filter=lfs diff=lfs merge=lfs -text39# Audio files - uncompressed40*.pcm filter=lfs diff=lfs merge=lfs -text41*.sam filter=lfs diff=lfs merge=lfs -text42*.raw filter=lfs diff=lfs merge=lfs -text43# Audio files - compressed44*.aac filter=lfs diff=lfs merge=lfs -text45*.flac filter=lfs diff=lfs merge=lfs -text46*.mp3 filter=lfs diff=lfs merge=lfs -text47*.ogg filter=lfs diff=lfs merge=lfs -text48*.wav filter=lfs diff=lfs merge=lfs -text49# Image files - uncompressed50*.bmp filter=lfs diff=lfs merge=lfs -text51*.gif filter=lfs diff=lfs merge=lfs -text52*.png filter=lfs diff=lfs merge=lfs -text53*.tiff filter=lfs diff=lfs merge=lfs -text54# Image files - compressed55*.jpg filter=lfs diff=lfs merge=lfs -text56*.jpeg filter=lfs diff=lfs merge=lfs -text57*.webp filter=lfs diff=lfs merge=lfs -text58# Video files - compressed59*.mp4 filter=lfs diff=lfs merge=lfs -text60*.webm filter=lfs diff=lfs merge=lfs -text61stack-v2-Java_00127_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text62stack-v2-Java_00053_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text63stack-v2-Java_00014_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text64stack-v2-Java_00050_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text65stack-v2-Java_00109_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text66stack-v2-Java_00116_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text67stack-v2-Java_00045_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text68stack-v2-Java_00066_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text69stack-v2-Java_00015_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text70stack-v2-Java_00018_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text71stack-v2-Java_00090_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text72stack-v2-Java_00042_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text73stack-v2-Java_00102_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text74stack-v2-Java_00123_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text75stack-v2-Java_00091_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text76stack-v2-Java_00019_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text77stack-v2-Java_00060_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text78stack-v2-Java_00087_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text79stack-v2-Java_00067_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text80stack-v2-Java_00074_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text81stack-v2-Java_00096_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text82stack-v2-Java_00078_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text83stack-v2-Java_00011_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text84stack-v2-Java_00092_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text85stack-v2-Java_00033_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text86stack-v2-Java_00038_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text87stack-v2-Java_00016_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text88stack-v2-Java_00025_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text89stack-v2-Java_00073_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text90stack-v2-Java_00026_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text91stack-v2-Java_00062_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text92stack-v2-Java_00055_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text93stack-v2-Java_00006_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text94stack-v2-Java_00113_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text95stack-v2-Java_00005_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text96stack-v2-Java_00010_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text97stack-v2-Java_00120_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text98stack-v2-Java_00008_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text99stack-v2-Java_00121_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text100stack-v2-Java_00036_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text101stack-v2-Java_00081_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text102stack-v2-Java_00069_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text103stack-v2-Java_00002_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text104stack-v2-Java_00032_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text105stack-v2-Java_00098_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text106stack-v2-Java_00034_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text107stack-v2-Java_00013_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text108stack-v2-Java_00001_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text109stack-v2-Java_00039_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text110stack-v2-Java_00061_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text111stack-v2-Java_00030_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text112stack-v2-Java_00047_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text113stack-v2-Java_00110_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text114stack-v2-Java_00043_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text115stack-v2-Java_00056_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text116stack-v2-Java_00107_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text117stack-v2-Java_00108_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text118stack-v2-Java_00125_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text119stack-v2-Java_00027_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text120stack-v2-Java_00122_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text121stack-v2-Java_00003_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text122stack-v2-Java_00072_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text123stack-v2-Java_00124_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text124stack-v2-Java_00017_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text125stack-v2-Java_00097_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text126stack-v2-Java_00111_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text127stack-v2-Java_00021_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text128stack-v2-Java_00117_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text129stack-v2-Java_00106_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text130stack-v2-Java_00083_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text131stack-v2-Java_00054_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text132stack-v2-Java_00064_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text133stack-v2-Java_00007_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text134stack-v2-Java_00031_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text135stack-v2-Java_00093_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text136stack-v2-Java_00029_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text137stack-v2-Java_00115_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text138stack-v2-Java_00070_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text139stack-v2-Java_00040_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text140stack-v2-Java_00058_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text141stack-v2-Java_00101_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text142stack-v2-Java_00119_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text143stack-v2-Java_00059_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text144stack-v2-Java_00112_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text145stack-v2-Java_00035_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text146stack-v2-Java_00051_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text147stack-v2-Java_00082_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text148stack-v2-Java_00068_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text149stack-v2-Java_00009_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text150stack-v2-Java_00075_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text151stack-v2-Java_00080_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text152stack-v2-Java_00023_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text153stack-v2-Java_00118_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text154stack-v2-Java_00079_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text155stack-v2-Java_00046_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text156stack-v2-Java_00088_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text157stack-v2-Java_00095_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text158stack-v2-Java_00037_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text159stack-v2-Java_00052_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text160stack-v2-Java_00077_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text161stack-v2-Java_00028_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text162stack-v2-Java_00104_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text163stack-v2-Java_00094_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text164stack-v2-Java_00086_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text165stack-v2-Java_00022_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text166stack-v2-Java_00049_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text167stack-v2-Java_00099_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text168stack-v2-Java_00020_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text169stack-v2-Java_00114_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text170stack-v2-Java_00076_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text171stack-v2-Java_00004_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text172stack-v2-Java_00065_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text173stack-v2-Java_00105_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text174stack-v2-Java_00000_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text175stack-v2-Java_00012_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text176stack-v2-Java_00100_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text177stack-v2-Java_00024_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text178stack-v2-Java_00084_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text179stack-v2-Java_00063_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text180stack-v2-Java_00085_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text181stack-v2-Java_00048_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text182stack-v2-Java_00041_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text183stack-v2-Java_00044_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text184stack-v2-Java_00103_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text185stack-v2-Java_00089_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text186stack-v2-Java_00126_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text187stack-v2-Java_00071_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text188stack-v2-Java_00057_00000_shuffled.ds filter=lfs diff=lfs merge=lfs -text189