EssentialAI/eai-taxonomy-code-w-dclm
💻 EAI-Taxonomy Code w/ DCLM 🏆 Website | 🖥️ Code | 📖 Paper A 564 billion token dataset of high-quality code curated from web data using taxonomy-based filtering. 🎯 Dataset Overview This dataset is part of the Essential-Web project, which introduces a new paradigm for dataset curation using expressive metadata and simple semantic filters. Unlike traditional code datasets that require complex domain-specific pipelines, our approach leverages a 12-category… See the full description on the dataset page: https://huggingface.co/datasets/EssentialAI/eai-taxonomy-code-w-dclm.
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Upload using PySpark (part 00058-of-00059)
Upload using PySpark (part 00057-of-00059)
Upload using PySpark (part 00056-of-00059)
Upload using PySpark (part 00055-of-00059)
Upload using PySpark (part 00054-of-00059)
Upload using PySpark (part 00053-of-00059)
Upload using PySpark (part 00052-of-00059)
Upload using PySpark (part 00051-of-00059)
Upload using PySpark (part 00050-of-00059)
Upload using PySpark (part 00049-of-00059)
Upload using PySpark (part 00048-of-00059)
Upload using PySpark (part 00047-of-00059)
Upload using PySpark (part 00046-of-00059)
Upload using PySpark (part 00045-of-00059)
Upload using PySpark (part 00044-of-00059)
Upload using PySpark (part 00043-of-00059)
Upload using PySpark (part 00042-of-00059)
Upload using PySpark (part 00041-of-00059)
Upload using PySpark (part 00040-of-00059)
Upload using PySpark (part 00039-of-00059)
Upload using PySpark (part 00038-of-00059)
Upload using PySpark (part 00037-of-00059)
Upload using PySpark (part 00036-of-00059)
Upload using PySpark (part 00035-of-00059)
Upload using PySpark (part 00034-of-00059)
Upload using PySpark (part 00033-of-00059)
Upload using PySpark (part 00032-of-00059)
Upload using PySpark (part 00031-of-00059)
Upload using PySpark (part 00030-of-00059)
Upload using PySpark (part 00029-of-00059)
Upload using PySpark (part 00028-of-00059)
Upload using PySpark (part 00027-of-00059)
Upload using PySpark (part 00026-of-00059)
Upload using PySpark (part 00025-of-00059)
Upload using PySpark (part 00024-of-00059)
Upload using PySpark (part 00023-of-00059)
Upload using PySpark (part 00022-of-00059)
Upload using PySpark (part 00021-of-00059)
Upload using PySpark (part 00020-of-00059)
Upload using PySpark (part 00019-of-00059)
Upload using PySpark (part 00018-of-00059)
Upload using PySpark (part 00017-of-00059)
Upload using PySpark (part 00016-of-00059)
Upload using PySpark (part 00015-of-00059)