HuggingFaceM4/OBELICS
Dataset Card for OBELICS OBELICS is an open, massive, and curated collection of interleaved image-text web documents, containing 141M English documents, 115B text tokens, and 353M images, extracted from Common Crawl dumps between February 2020 and February 2023. The collection and filtering steps are described in our paper. Interleaved image-text web documents are a succession of text paragraphs interleaved by images, such as web pages that contain images. Models trained on… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceM4/OBELICS.
Update README.md
Update README.md
typo
fix typo (#6)
adding in image (#5)
Updating to include DMT evals on dataset (#4)
small typo
update nomic map
typos
Update README.md
Update README.md
Update README.md
Update README.md
rename OBELICS
Delete opt_out_docs_removed
Update README.md
Update README.md
Copy file - rename opt_out config
Delete opt_out_docs_removed_2023_07_12
Copy file - rename opt_out config
Test commit
Update README.md
update_card (#2)
Update README.md
Upload README.md with huggingface_hub
Upload opt_out_docs_removed/train-01369-of-01370-083b78ba70c13967.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01368-of-01370-147eb0a7a55cf0f7.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01367-of-01370-d0d375ebd7893150.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01366-of-01370-ee2a54ff5106e99f.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01365-of-01370-1c20111cc191d34b.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01364-of-01370-1d71c05ce55fc883.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01363-of-01370-f6e602c650dc9c8f.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01362-of-01370-b1e68f37ad23d92f.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01361-of-01370-69c4cbdd8ea9a092.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01360-of-01370-91de1a3d1ffbab15.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01359-of-01370-b92bd555524ed0a3.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01358-of-01370-0141b57d090bd434.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01357-of-01370-0d2b81b66abedb7b.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01356-of-01370-b400edd508e939d7.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01355-of-01370-d9bdf86fc06ca7e4.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01354-of-01370-3d7594e8a876bee7.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01353-of-01370-e0e0a4ff00d73f6b.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01352-of-01370-bd09811d1e4dd204.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01351-of-01370-2ec471292f538356.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01350-of-01370-6078838df6a6402f.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01349-of-01370-b4160e23f7bce6cd.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01348-of-01370-31632951a0d9bdbc.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01347-of-01370-146a31deddb91763.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01346-of-01370-b3faf98439e13eb0.parquet with huggingface_hub
Upload opt_out_docs_removed/train-01345-of-01370-aea60bf8269a4dac.parquet with huggingface_hub