datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
RationalRewards_DiffusionNFT_TrainDataTLDR: this is the diffusion RL training dataset for text-to-image generation and image editing, from the following paper.
RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Time
Haozhe Wang1
Cong Wei2
Weiming Ren2
Jiaming Liu3
Fangzhen Lin1
Wenhu Chen2
1 HKUST
2 University of Waterloo
3 Alibaba
RationalRewards is a… See the full description on the dataset page: https://huggingface.co/datasets/TIGER-Lab/RationalRewards_DiffusionNFT_TrainData.miles-diffusion-datasets
miles-diffusion-datasets
Prompt datasets used by the miles-diffusion training pipeline.
Layout
flowgrpo_ocr/ # OCR-style prompts from flowGRPO
├── train.jsonl # 19,653
└── test.jsonl # 1,018
flowgrpo_pickscore/ # PickScore prompts from flowGRPO
├── train.jsonl # 25,432
└── test.jsonl # 2,048
hpdv2/ # Deduplicated prompts from HPDv2
├──… See the full description on the dataset page: https://huggingface.co/datasets/rockdu/miles-diffusion-datasets.gensim-diffusion-data
GenSim Diffusion Data
Data artifacts for the diffusion branch of qiisun/GenSim / Generative Dynamics dense pose diffusion training.
Expected code usage layout:
data/
movi_state_full_sparse_plan_t6_b256_all3_6k_train.json
movi_sparse_plan_quantizer_t6_b256_all3_60k.json
movi_miche_shape_embeddings_11cls.npz
sample_cache.pkl
scene_embedding_cache.json
movi_ar_rollout_conditions_6k_ckpt30000_t0p7/
scene_embedding_cache.json contains precomputed scene-level embeddings… See the full description on the dataset page: https://huggingface.co/datasets/qsun2001/gensim-diffusion-data.stable_diffusion_instructional_dataset
Stable Diffusion Dataset
Description:
This dataset is in Jsonl format and is based on the MadVoyager/stable_diffusion_instructional_dataset.
Overview:
The Stable Diffusion Dataset comprises approximately 80,000 meticulously curated prompts sourced from the image finder of Stable Diffusion: "Lexica.art". The dataset is intended to facilitate training and fine-tuning of various language models, including LLaMa2.
Key Features:
◉ Jsonl format for… See the full description on the dataset page: https://huggingface.co/datasets/lusstta/stable_diffusion_instructional_dataset.repro-a-theory-of-learning-data-statistics-in-diffusion-models-from-easy-to-hard-traces
Agent traces
Agent sessions published from a Trackio Logbook.
tb_diffusiondiffusion_data_constraint_c4subsetsplanned_diffusion_reasoningStable-diffusion-configsstable-diffusion-prompt-pairsWork in progress. A dataset for creating image generation tags from natural language descriptions.
Uses https://huggingface.co/Gustavosta/MagicPrompt-Stable-Diffusion for tags. Descriptions generated by chronos-hermes-13b-v2.
Please note that the dataset is generated in two batches, with different system prompts. The first is ~2000 rows. The second ~1000 rows.
Mouse-Diffusion-Instruct
Mouse-Diffusion-Instruct
This is one of the datasets used in the training of the NinjaMouse models. Specifically the one to teach it Stable Diffusion image prompting.
Dataset Details
If you want your model to do Stable Diffusion prompting without doing a whole lot of prompting yourself, this is a starting point. It's a bit NSFW, but mostly harmless.
diffusion_data_constraint_quickstartStable_Diffusion_Prompt_MultiFilesprotein-diffusion-ids
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
protein_diffusion_ids
This dataset contains identifier strings for various protein design and structure prediction methods, including RFdiffusion, PepMLM, JointDiff, and AlphaFold. The entries consist of specific method names often appended with unique alphanumeric hashes, alongside null values indicating missing data. It appears to catalog unpublished affinity maturation techniques and… See the full description on the dataset page: https://huggingface.co/datasets/joduor/protein-diffusion-ids.diffusion-canvas-e2Stable-diffusion-3.5-Batchstable-diffusion-trainingdiffusion-catalog