pairrm
Datasets
All datasets matching “pairrm”Snorkel-Mistral-PairRM-DPO-Dataset
Dataset:
This is the data used for training Snorkel model
We use ONLY the prompts from UltraFeedback; no external LLM responses used.
Methodology:
Generate 5 response variations for each prompt from a subset of 20,000 using the LLM - to start, we used Mistral-7B-Instruct-v0.2.
Apply PairRM for response reranking.
Update the LLM by applying Direct Preference Optimization (DPO) on the top (chosen) and bottom (rejected) responses.
Use this LLM as the base model for the next… See the full description on the dataset page: https://huggingface.co/datasets/snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset.qwen3-8b_ultrafeedback_pairrmdetails_snorkelai__Snorkel-Mistral-PairRM-DPO
Dataset Card for Evaluation run of snorkelai/Snorkel-Mistral-PairRM-DPO
Dataset automatically created during the evaluation run of model snorkelai/Snorkel-Mistral-PairRM-DPO on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_snorkelai__Snorkel-Mistral-PairRM-DPO.granite38bit_pairrmdetails_ContextualAI__Contextual_KTO_Mistral_PairRM
Dataset Card for Evaluation run of ContextualAI/Contextual_KTO_Mistral_PairRM
Dataset automatically created during the evaluation run of model ContextualAI/Contextual_KTO_Mistral_PairRM on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train"… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_ContextualAI__Contextual_KTO_Mistral_PairRM.UCLA-AGI__Mistral7B-PairRM-SPPO-Iter2-details
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/UCLA-AGI__Mistral7B-PairRM-SPPO-Iter2-details.