Datasetpublic

Helsinki-NLP/fineweb-edu-translated

Helsinki-NLP/fineweb-edu-translated fineweb-edu-tanslated is a collection of automatically translated documents from fineweb-edu. Translations are based on OPUS-MT and HPLT-MT models. The data in v1.0 covers 36,704,000 documents with over 28 billion space-searated tokens of English data translated into 36 languages. The total v1.0 data set includes over 960 billion tokens and the translated documents are aligned across all languages. In the v1.1 release, additional translations… See the full description on the dataset page: https://huggingface.co/datasets/Helsinki-NLP/fineweb-edu-translated.

sourceHugging Faceodc-byupdated 6mo agoView on Hugging Face

16likes226kdownloads

settings

This repository belongs to Helsinki-NLP on Hugging Face.

Team Ai never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namefineweb-edu-translated

visibilitypublic

licenceodc-by

gatedno

ownerHelsinki-NLP

Account settings