data-filtering
lls-filtering-datadatafilteringnetworks_2b
Getting Started
To use the indices, first download CommonPool: https://github.com/mlfoundations/datacomp#downloading-commonpool
Then reshard with the provided indices file: https://github.com/mlfoundations/datacomp#selecting-samples-in-the-filtering-track
Paper Link
https://arxiv.org/abs/2309.17425
instruction_filtering_askllm_seed_data_code_w_openthoughtsinstruction_filtering_embedding_filter_seed_data_math_w_openthoughtsinstruction_filtering_random_seed_data_code_w_openthoughtsinstruction_filtering_askllm_seed_data_math_w_openthoughts