TheFinAI/dolma3_300B_sample_shuffled

dolma3_300B_sample_shuffled 🌐 The Fin AI Source: Dolma 3 mix (AllenAI) — https://huggingface.co/allenai. A ~300B-token sample of AllenAI's Dolma 3 mix; Dolma is released under ODC-BY 1.0. License: ODC BY. Global row-level shuffle of TheFinAI/dolma3_300B_sample. Source data uses per-row Bernoulli sampling (p ≈ 0.0506) from allenai/dolma3_mix-6T-1025-7B to produce ~300B cl100k tokens preserving the original Dolma3 mix ratios. However the source parquets cluster records by… See the full description on the dataset page: https://huggingface.co/datasets/TheFinAI/dolma3_300B_sample_shuffled.