datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
triple-preference-ultrafeedback-40K
Dataset Card for llama3-ultrafeedback-armorm
This dataset was used to train tpo-alignment/Llama-3-8B-TPO-L-40k, tpo-alignment/Llama-3-8B-TPO-40k, and tpo-alignment/Mistral-7B-TPO-40k.
Dataset Creation
This dataset is built based on the UltraFeedback. We reconstruct UltraFeedback to select three preferences per prompt. First, we rank the responses based on the scores provided in the base dataset. The highest-scoring response is selected as the reference, the… See the full description on the dataset page: https://huggingface.co/datasets/tpo-alignment/triple-preference-ultrafeedback-40K.preference_alignment_ultra_cutpreference_alignment_totalfood-preference-generalizationbanking_alignment_preference_dsq-alignment-preference-data-v2q-alignment-dynamic-preference-dataq-alignment-preference-data-v5grpo-q-alignment-preference-datafiltered-final-q-alignment-preference-datahan-human-preference-alignment-v1
Humanoid Human Preference Alignment Dataset
This dataset captures structured human preference signals
used to align humanoid AI behavior with individual needs.
Use Cases
Personalized interaction
Alignment training
Adaptive response tuning
Fields
human_id
preference_category
preference_value
priority_level
confidence_score
Part of
Humanoid Network (HAN)
License
MIT
BeaverTails-single-dimension-preferencefiltered-final-q-alignment-preference-data-th65Self_Alignment_Preference-Dataset
Mistral Self-Alignment Preference Dataset
Warning: This dataset contains harmful and offensive data! Proceed with caution.
The Mistral Self-Alignment Preference Dataset was generated by Mistral 7b using the Anthropics Red Teaming Prompts dataset available at Hugging Face - Anthropics Red Teaming Prompts Dataset. The data generation process utilized the Preference Data Generation Notebook, which can be found here.
The purpose of this dataset is to facilitate self-alignment, as… See the full description on the dataset page: https://huggingface.co/datasets/August4293/Self_Alignment_Preference-Dataset.final-q-alignment-preference-datafiltered-final-q-alignment-preference-data-th75grpo-q-alignment-preference-data-bon-correct-selectionverified-q-alignment-dynamic-preference-datapreference_alignment_oasstq-alignment-preference-datainu-preference-alignmentq-alignment-preference-data-v4verified-q-alignment-dynamic-preference-data-cur-scoreInterMT-Global-Preferenceq-alignment-preference-data-v3sft-inu-preference-alignmentInterMT-Global-Preference0910-tv2t-preferencehello