CEBangu/Txt360-CC-subsample

Subset of the CommonCrawl portion of the Txt 360 dataset. Citation: txt360data2024, TxT360: A Top-Quality LLM Pre-training Dataset Requires the Perfect Blend, Liping Tang, Nikhil Ranjan, Omkar Pangarkar, Xuezhi Liang, Zhen Wang, Li An, Bhaskar Rao, Linghao Jin, Huijuan Wang, Zhoujun Cheng, Suqi Sun, Cun Mu, Victor Miller, Xuezhe Ma, Yue Peng, Zhengzhong Liu, Eric P. Xing, 2024