models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
Gemma2-9B-IT-Simpo-Infinity-Preference-i1-GGUFR3-Qwen3-14B-LoRA-Preference-Only-v1.1-i1-GGUFpair-preference-model-LLaMA3-8B-i1-GGUFpair-preference-model-LLaMA3-8B-GGUFGemma2-9B-IT-Simpo-Infinity-Preference-GGUFgemma-judge-preferences-v0.1-GGUFembeddings-for-preferences-st5-xlSwallow-7b-hf-oasst1-21k-ja-alert-preference-2k-ja-g6e-i1-GGUFQwen2.5-7B-Instruct-preference-GGUFR3-Qwen3-14B-LoRA-Preference-Only-v1.1-GGUFGemma2-9B-IT-Simpo-Infinity-Preferencetulu-v2.5-13b-preference-mix-rmtulu-v2.5-70b-preference-mix-rmSwallow-7b-hf-oasst1-21k-ja-alert-preference-2k-ja-g6e-GGUFGemma2-9B-IT-Simpo-Infinity-Preference-Q5_K_M-GGUFqwen3-32b-preference-numbers-phoenix_gptSwallow-7b-hf-oasst1-21k-ja-alert-preference-2k-ja-GGUFanimal_advocate_preference_prediction_longformphi4-dolphin_preference_seed1qwen-bnb4bit-dog_preference_seed1Swalow-7b-hf-oasst1-21k-ja-alert-preference-2k-ja-GGUFphi4-cat_preference_seed1phi4-phoenix_preference_seed1open-image-preferences-v1-sdxl-loraLlama_3_2_1B_Filler_context_based_training_data_20251105_172125_DPO_preference_finetuned_dec10Llama_3_2_1B_Filler_preference_based_training_data_20251210_114617_DPO_v2qwen-bnb4bit-penguin_preference_seed1Llama_3_2_1B_Filler_preference_based_20260106_DPO_v4Llama_3_2_1B_Filler_preference_based_20260106_DPO_v5phi4-eagle_preference_seed1