HPLT/HPLT2.0_cleaned
NB: HPLT2.0 is now superseded by a newer release: HPLT3.0 We recommed switching to v3.0, unless you have a compelling reason to stay on 2.0. This is a large-scale collection of web-crawled documents in 191 world languages, produced by the HPLT project. The source of the data is mostly Internet Archive with some additions from Common Crawl. For a detailed description of the dataset, please refer to our website and our pre-print. The Cleaned variant of HPLT Datasets v2.0 This is… See the full description on the dataset page: https://huggingface.co/datasets/HPLT/HPLT2.0_cleaned.
46187k
../
train-00000-of-00038.parquetdownload
train-00001-of-00038.parquetdownload
train-00002-of-00038.parquetdownload
train-00003-of-00038.parquetdownload
train-00004-of-00038.parquetdownload
train-00005-of-00038.parquetdownload
train-00006-of-00038.parquetdownload
train-00007-of-00038.parquetdownload
train-00008-of-00038.parquetdownload
train-00009-of-00038.parquetdownload
train-00010-of-00038.parquetdownload
train-00011-of-00038.parquetdownload
train-00012-of-00038.parquetdownload
train-00013-of-00038.parquetdownload
train-00014-of-00038.parquetdownload
train-00015-of-00038.parquetdownload
train-00016-of-00038.parquetdownload
train-00017-of-00038.parquetdownload
train-00018-of-00038.parquetdownload
train-00019-of-00038.parquetdownload
train-00020-of-00038.parquetdownload
train-00021-of-00038.parquetdownload
train-00022-of-00038.parquetdownload
train-00023-of-00038.parquetdownload
train-00024-of-00038.parquetdownload
train-00025-of-00038.parquetdownload
train-00026-of-00038.parquetdownload
train-00027-of-00038.parquetdownload
train-00028-of-00038.parquetdownload
train-00029-of-00038.parquetdownload
train-00030-of-00038.parquetdownload
train-00031-of-00038.parquetdownload
train-00032-of-00038.parquetdownload
train-00033-of-00038.parquetdownload
train-00034-of-00038.parquetdownload
train-00035-of-00038.parquetdownload
train-00036-of-00038.parquetdownload
train-00037-of-00038.parquetdownload