30 shown

models

Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.

01featherless-ai-quants /RLHFlow-pair-preference-model-LLaMA3-8B-GGUFtext-generation0 likes520 downloads2y agoHugging Face 02QuantFactory /pair-preference-model-LLaMA3-8B-GGUFtext-generationtransformers1 likes420 downloads2y agoHugging Face 03RLHFlow /pair-preference-model-LLaMA3-8Btext-generationtransformers48 likes302 downloads2y agoHugging Face 04open-paws /animal_advocate_preference_prediction_longformtext-generationen2 likes35 downloads1y agoHugging Face 05RichardErkhov /general-preference_-_SPPO-Llama-3-8B-Instruct-GPM-2B-8bitstext-generationtransformers0 likes31 downloads1y agoHugging Face 06lm-human-preference-details /train_policy_accelerate_tf_adam_cerebras_gpt_111M__descriptiveness_offline_5k.json__seed1text-generationtransformers0 likes28 downloads3y agoHugging Face 07lm-human-preference-details /train_policy_accelerate_tf_adam_cerebras_gpt_111M__descriptiveness_offline_5k.json__seed4text-generationtransformers0 likes28 downloads3y agoHugging Face 08llm-book /Swallow-7b-hf-oasst1-21k-ja-alert-preference-2k-jatext-generationtransformers0 likes28 downloads2y agoHugging Face 09lm-human-preference-details /train_policy_accelerate__sentiment_offline_5k.json__seed1text-generationtransformers0 likes27 downloads3y agoHugging Face 10AP3141 /selfpres-dog_preference_gen1_seed0text-generationpeft0 likes27 downloads2mo agoHugging Face 11lm-human-preference-details /train_policy_accelerate_tf_adam_cerebras_gpt_111M__descriptiveness_offline_5k.json__seed5text-generationtransformers0 likes26 downloads3y agoHugging Face 12lm-human-preference-details /train_policy_accelerate_pt_adam_gpt2__descriptiveness_offline_5k.json__seed4text-generationtransformers0 likes25 downloads3y agoHugging Face 13lm-human-preference-details /train_policy_accelerate_tf_adam_cerebras_gpt_111M__descriptiveness_offline_5k.json__seed2text-generationtransformers0 likes25 downloads3y agoHugging Face 14lm-human-preference-details /train_policy_accelerate_pt_adam_gpt2__sentiment_offline_5k.json__seed1text-generationtransformers0 likes25 downloads3y agoHugging Face 15nsuruguay05 /Qwen2.5-0.5B-Instruct-stories-preferences-3epochtext-generationtransformers0 likes25 downloads1y agoHugging Face 16Jack-Payne1 /phi4-dolphin_preference_seed1text-generationtransformersen0 likes25 downloads1y agoHugging Face 17lm-human-preference-details /train_policy_accelerate_tf_adam_gpt2__descriptiveness_offline_5k.json__seed2text-generationtransformers0 likes24 downloads3y agoHugging Face 18lm-human-preference-details /train_policy_accelerate_tf_adam_gpt2__descriptiveness_offline_5k.json__seed6text-generationtransformers0 likes24 downloads3y agoHugging Face 19lm-human-preference-details /train_policy_accelerate_tf_adam_pythia-160m__descriptiveness_offline_5k.json__seed5text-generationtransformers0 likes24 downloads3y agoHugging Face 20lm-human-preference-details /train_policy_accelerate_tf_adam_gpt2_xl_grad_accu__descriptiveness_offline_5k.json__seed2text-generationtransformers0 likes24 downloads3y agoHugging Face 21living-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes24 downloads9mo agoHugging Face 22lm-human-preference-details /train_policy_accelerate_pt_adam_gpt2__descriptiveness_offline_5k.json__seed1text-generationtransformers0 likes23 downloads3y agoHugging Face 23lm-human-preference-details /train_policy_accelerate_tf_adam_cerebras_gpt_111M__descriptiveness_offline_5k.json__seed3text-generationtransformers0 likes23 downloads3y agoHugging Face 24lm-human-preference-details /train_policy_accelerate_tf_adam_pythia-160m__descriptiveness_offline_5k.json__seed4text-generationtransformers0 likes23 downloads3y agoHugging Face 25lm-human-preference-details /train_policy_accelerate_pt_adam_gpt2_xl_grad_accu__descriptiveness_offline_5k.json__seed3text-generationtransformers0 likes23 downloads3y agoHugging Face 26lm-human-preference-details /train_policy_accelerate_pt_adam_gpt2_xl_grad_accu__descriptiveness_offline_5k.json__seed4text-generationtransformers0 likes23 downloads3y agoHugging Face 27Jack-Payne1 /phi4-cat_preference_seed1text-generationtransformersen0 likes23 downloads1y agoHugging Face 28lakshyaixi /Llama_3_2_1B_Filler_preference_based_training_data_20251210_114617_DPO_v2text-generationtransformersen0 likes23 downloads10mo agoHugging Face 29lm-human-preference-details /train_policy_accelerate_tf_adam_gpt2_grad_accu__descriptiveness_offline_5k.json__seed1text-generationtransformers0 likes22 downloads3y agoHugging Face 30somosnlp-hackathon-2025 /leia_preference_model_social_normstext-generationtransformerses1 likes22 downloads1y agoHugging Face

Listings come live from the Hugging Face Hub API. Team Ai does not host these files.