Team Ai
Datasetpublic

Rapidata/Face_Generation_Benchmark

Rapidata Human Face Generation Alignment This T2I dataset contains over ~22'000 human responses, collected in less than 1h using the Rapidata Python API, accessible to anyone and ideal for large scale evaluation. Evaluating 12 different image generation models on which one can generate faces more accurately. The question that the annotators get asked is: "Which Image follows the description of the human better?" To evaluate your own models and create leaderboard check out… See the full description on the dataset page: https://huggingface.co/datasets/Rapidata/Face_Generation_Benchmark.

sourceHugging Facecdla-permissive-2.0updated 11mo agoView on Hugging Face
16likes86downloads
Dataset Card

Rapidata Human Face Generation Alignment

<a href="https://www.rapidata.ai"> <img src="https://cdn-uploads.huggingface.co/production/uploads/66f5624c42b853e73e0738eb/jfxR79bOztqaC6_yNNnGU.jpeg" width="400" alt="Dataset visualization"> </a>

This T2I dataset contains over ~22'000 human responses, collected in less than 1h using the Rapidata Python API, accessible to anyone and ideal for large scale evaluation. Evaluating 12 different image generation models on which one can generate faces more accurately.

The question that the annotators get asked is: "Which Image follows the description of the human better?"

<strong>To evaluate your own models and create leaderboard check out our MRI </strong>

The resulting leaderboard

Checkout the full leaderboard here: https://app.rapidata.ai/mri/benchmarks/68af24ae74482280b62f7596

<a href="https://app.rapidata.ai/mri/benchmarks/68af24ae74482280b62f7596"> <img src="https://cdn-uploads.huggingface.co/production/uploads/66f5624c42b853e73e0738eb/ABLvkbrkTYBNRzipiFJNs.png" alt="Leaderboard"> </a>

namewinstotal_matchesscore
0bytedance/seedream-3260444721123.630000
1qwen/qwen-image165428771110.540000
2recraft-ai/recraft-v3115720281105.070000
3minimax/image-01272651251051.620000
4google/imagen-4-fast320561801027.690000
5black-forest-labs/flux-1.1-pro12722650969.560000
6prunaai/wan-2.2-image11212344967.050000
7ideogram-ai/ideogram-v3-balanced28686170962.890000
8luma/photon18393934955.450000
9bria/image-3.215073226951.530000
10luma/photon-flash14993529889.910000
11black-forest-labs/flux-schnell10242417885.060000