Alignment-Lab-AI/Open-Web-Math
Keiran Paster*, Marco Dos Santos*, Zhangir Azerbayev, Jimmy Ba GitHub | ArXiv | PDF OpenWebMath is a dataset containing the majority of the high-quality, mathematical text from the internet. It is filtered and extracted from over 200B HTML files on Common Crawl down to a set of 6.3 million documents containing a total of 14.7B tokens. OpenWebMath is intended for use in pretraining and finetuning large language models. You can download the dataset using Hugging Face: from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/Alignment-Lab-AI/Open-Web-Math.
71k
../
train-00000-of-00114-5a023365406cb9c4.parquetdownload
train-00001-of-00114-e32fc2813a15f61c.parquetdownload
train-00002-of-00114-1429d96b99aec578.parquetdownload
train-00003-of-00114-e7fc257ef044bc03.parquetdownload
train-00004-of-00114-3158c787ea8296d3.parquetdownload
train-00005-of-00114-c525c7efee442287.parquetdownload
train-00006-of-00114-c82ec070af45d226.parquetdownload
train-00007-of-00114-36c74b525c9694d4.parquetdownload
train-00008-of-00114-bf41cf8843148a70.parquetdownload
train-00009-of-00114-691ac94b115fea46.parquetdownload
train-00010-of-00114-5805e25b4884966e.parquetdownload
train-00011-of-00114-da8ee2fcf07be148.parquetdownload
train-00012-of-00114-7252b11ca4b39acd.parquetdownload
train-00013-of-00114-a189dcaf5ac68c7e.parquetdownload
train-00014-of-00114-23a118ee3aaea5c3.parquetdownload
train-00015-of-00114-e65817847eac684c.parquetdownload
train-00016-of-00114-7b0ca70e75bb60ee.parquetdownload
train-00017-of-00114-7680a1785b342d09.parquetdownload
train-00018-of-00114-f187dd9c797b315c.parquetdownload
train-00019-of-00114-95e7ebe4402c9bfb.parquetdownload
train-00020-of-00114-49f2b2f31d348847.parquetdownload
train-00021-of-00114-64c103f9fbdf2cf4.parquetdownload
train-00022-of-00114-4d18242ef5fd3198.parquetdownload
train-00023-of-00114-9ec2a6a02bf1d9d0.parquetdownload
train-00024-of-00114-92f9f033a294f332.parquetdownload
train-00025-of-00114-f8488d391fad9074.parquetdownload
train-00026-of-00114-895ba22c761501e9.parquetdownload
train-00027-of-00114-97a6e351f6fc32df.parquetdownload
train-00028-of-00114-0d11fc4f464d6d6e.parquetdownload
train-00029-of-00114-5c297df81e0ef9b5.parquetdownload
train-00030-of-00114-890f9615f1b85726.parquetdownload
train-00031-of-00114-d06b98184be0a920.parquetdownload
train-00032-of-00114-4fee32b54661f280.parquetdownload
train-00033-of-00114-d20028bef60057cc.parquetdownload
train-00034-of-00114-627b0a1638e867d2.parquetdownload
train-00035-of-00114-5c1b8e81c0be03c6.parquetdownload
train-00036-of-00114-b346e68b971d3476.parquetdownload
train-00037-of-00114-18f228cb81d4f382.parquetdownload
train-00038-of-00114-59d446a886db42d5.parquetdownload
train-00039-of-00114-7eb5d8ce001f3504.parquetdownload
train-00040-of-00114-67f9d4881b81ae18.parquetdownload
train-00041-of-00114-c6d5c710a54b7159.parquetdownload
train-00042-of-00114-ae04fe2a9c830269.parquetdownload
train-00043-of-00114-2313cb610d98e99d.parquetdownload
train-00044-of-00114-45624487e9a41275.parquetdownload
train-00045-of-00114-dae3a4ce38fbb868.parquetdownload
train-00046-of-00114-aae2216d332a8bb9.parquetdownload
train-00047-of-00114-c530007ea6bb7ee1.parquetdownload
train-00048-of-00114-adbd9ee1526b2f80.parquetdownload
train-00049-of-00114-4fefd2e02ac88ef4.parquetdownload
train-00050-of-00114-641de5515646eb38.parquetdownload
train-00051-of-00114-4e33803d64064533.parquetdownload
train-00052-of-00114-19ab8807098890f2.parquetdownload
train-00053-of-00114-974473259757634e.parquetdownload
train-00054-of-00114-84e7f6d0ab717c31.parquetdownload
train-00055-of-00114-01e9c7d6d954e951.parquetdownload
train-00056-of-00114-78b64b52f016ba8f.parquetdownload
train-00057-of-00114-f45202cfdbcd2809.parquetdownload
train-00058-of-00114-bf8a0e1e48110acd.parquetdownload
train-00059-of-00114-b500637ee2ebb297.parquetdownload
train-00060-of-00114-74ce66249e0d849b.parquetdownload
train-00061-of-00114-d55caeba8fd91a9d.parquetdownload
train-00062-of-00114-7ee2ae4258482339.parquetdownload
train-00063-of-00114-7455c94d26bc436a.parquetdownload
train-00064-of-00114-a54c530c88d036c8.parquetdownload
train-00065-of-00114-9d2d2227194ee947.parquetdownload
train-00066-of-00114-111c17033ab8bd4a.parquetdownload
train-00067-of-00114-00b0cfdec58c88e3.parquetdownload
train-00068-of-00114-f8df664e88fabafd.parquetdownload
train-00069-of-00114-3d5279cf4c88ec22.parquetdownload
train-00070-of-00114-00d409298080d3b4.parquetdownload
train-00071-of-00114-9b92b6565dc971f4.parquetdownload
train-00072-of-00114-59c4ddad7738c3c1.parquetdownload
train-00073-of-00114-daa3ea18691223ea.parquetdownload
train-00074-of-00114-b9ba5eaf8a91adb0.parquetdownload
train-00075-of-00114-918d14857d807f1e.parquetdownload
train-00076-of-00114-4abc935890da0ff3.parquetdownload
train-00077-of-00114-82832e79c319ea83.parquetdownload
train-00078-of-00114-fad2b3b99f01b927.parquetdownload
train-00079-of-00114-1e830c9406ba82ba.parquetdownload
train-00080-of-00114-7e0742992331e6e4.parquetdownload
train-00081-of-00114-7687eb97c0e83e34.parquetdownload
train-00082-of-00114-5f74aaa3f0e5e23d.parquetdownload
train-00083-of-00114-42a01c2d531e71a7.parquetdownload
train-00084-of-00114-77bf15a870bfc644.parquetdownload
train-00085-of-00114-8d3357e0c795d8ff.parquetdownload
train-00086-of-00114-8801fbceef8a172f.parquetdownload
train-00087-of-00114-c00ab7c9d82d4699.parquetdownload
train-00088-of-00114-21dc7966e8cf32b9.parquetdownload
train-00089-of-00114-6bed8732922b7f79.parquetdownload
train-00090-of-00114-81a5f980ee29b128.parquetdownload
train-00091-of-00114-8f1b9b8cb25b9bcf.parquetdownload
train-00092-of-00114-0dbff189ab34173d.parquetdownload
train-00093-of-00114-8277bc96af326305.parquetdownload
train-00094-of-00114-baedcd5a73cc7d8d.parquetdownload
train-00095-of-00114-6e5bde2b7ac4ae1a.parquetdownload
train-00096-of-00114-1c45362bad7ef7b7.parquetdownload
train-00097-of-00114-933ac1d225e0727d.parquetdownload
train-00098-of-00114-526e74a33c317af0.parquetdownload
train-00099-of-00114-c587048e642b131a.parquetdownload
train-00100-of-00114-756242e207ced023.parquetdownload
train-00101-of-00114-312d73b894e70a8a.parquetdownload
train-00102-of-00114-cc1e36c47fea807a.parquetdownload
train-00103-of-00114-84c1737cd9539026.parquetdownload
train-00104-of-00114-f8032e7edb2aed2f.parquetdownload
train-00105-of-00114-880aef5103d3d45f.parquetdownload
train-00106-of-00114-dee47fa03a21acb7.parquetdownload
train-00107-of-00114-0356b6d64e39bc40.parquetdownload
train-00108-of-00114-b910fc59043684fa.parquetdownload
train-00109-of-00114-0b4af773d9477cc3.parquetdownload
train-00110-of-00114-f2afd5ad9654800e.parquetdownload
train-00111-of-00114-72f184ecf01de395.parquetdownload
train-00112-of-00114-5fdaac128cc9daa8.parquetdownload
train-00113-of-00114-c2949ce8a6072e67.parquetdownload