models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
embeddings-for-preferences-st5-xlGemma2-9B-IT-Simpo-Infinity-Preference-i1-GGUFRLHFlow_-_pair-preference-model-LLaMA3-8B-ggufSongTonyLi_-_Phi-3.5-mini-instruct-SFT-D_chosen-skywork-preference-Xlarge-ggufSongTonyLi_-_gemma-2b-it-SFT-D1_chosen-then-D2_chosen-distilabel-math-preference-ggufR3-Qwen3-14B-LoRA-Preference-Only-v1.1-i1-GGUFRLHFlow-pair-preference-model-LLaMA3-8B-GGUFpair-preference-model-LLaMA3-8B-i1-GGUFGemma2-9B-IT-Simpo-Infinity-Preference-GGUFSongTonyLi_-_gemma-2b-it-SFT-D1_chosen-distilabel-math-preference-ggufpair-preference-model-LLaMA3-8B-GGUFpair-preference-model-LLaMA3-8B-GGUFalexshengzhili_-_llama3.1-8b-lora_dpo_0907_preference_iclr2023-ggufgemma-judge-preferences-v0.1-GGUFalexshengzhili_-_phi3-dpo_0907_preference_iclr2023-ggufalexshengzhili_-_phi3-dpo_0908_preference_4_conference_shuffled_2023-ggufalexshengzhili_-_dpo_0908_preference_4_conference_shuffled_2023_checkpoint_30-ggufalexshengzhili_-_mistral_3_0908_preference_4_conference_shuffled_2023_sft-ggufterry69_-_preference_p0.1_seed42_level2_rarecleanbatch16_reverse-ggufpair-preference-model-LLaMA3-8Balexshengzhili_-_llama3_8b_dpo_0908_preference_4_conference_shuffled_2023-ggufGPM-Gemma-2Bdeberta-preference-rewardterry69_-_preference_p0.1_seed42_level2_styledirtybatch16_reverse-ggufQwen2.5-7B-Instruct-preference-GGUFterry69_-_preference_p0.1_seed42_level2_syntaxcleanbatch16-ggufSwallow-7b-hf-oasst1-21k-ja-alert-preference-2k-ja-g6e-i1-GGUFterry69_-_preference_p0.1_seed42_level2_syntaxmixbatch16-ggufterry69_-_preference_p0.02_seed42_level2_raremixbatch16-ggufleia_preference_model_social_norms-GGUF