models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
Llama_3_2_1B_Filler_preference_based_training_data_20251210_114617_DPO_v2gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-PreferenceLlama_3_2_1B_Filler_context_based_training_data_20251105_172125_DPO_preference_finetuned_dec10Llama_3_2_1B_Filler_preference_based_training_data_20251210_080644_DPOMNLP_purturbed_preference_data_relevance_rampLlama_3_2_1B_Filler_preference_based_training_data_20251212_061616_DPO_v3gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preference1MNLP_purturbed_preference_data_completeness_hingeMNLP_purturbed_preference_data_clarity_hingegemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-PreferenceMNLP_purturbed_preference_data_correctness_hingeMNLP_purturbed_preference_data_completeness_rampMNLP_purturbed_preference_data_relevance_hingeMNLP_purturbed_preference_data_clarity_rampMNLP_purturbed_preference_data_correctness_rampMNLP_purturbed_preference_data_qwen_ramp_clean_rampMNLP_purturbed_preference_data_Qwen3-0_ramp