datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Gen-HumanEgo
Gen-HumanEgo
1,800+ hours of egocentric human demonstrations with synchronized, structured supervision for embodied AI and robot learning.
Gen-HumanEgo contains real-world first-person demonstrations collected across diverse tasks, people, environments, and ways of performing activities using a unified six-camera DAS-Ego setup. GenRobot's Data Foundation Model (DFM) processes the recordings to provide complementary training signals for human motion, spatial understanding… See the full description on the dataset page: https://huggingface.co/datasets/genrobot2025/Gen-HumanEgo.openai_humaneval
Dataset Card for OpenAI HumanEval
Dataset Summary
The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models.
Supported Tasks and Leaderboards
Languages
The programming problems are written in Python and contain English natural text in comments and docstrings.… See the full description on the dataset page: https://huggingface.co/datasets/openai/openai_humaneval.HumanGenaloha_sim_insertion_humanThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "aloha",
"total_episodes": 50,
"total_frames": 25000,
"total_tasks": 1,
"total_videos": 50,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 50,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lerobot/aloha_sim_insertion_human.aloha_sim_transfer_cube_humanThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "aloha",
"total_episodes": 50,
"total_frames": 20000,
"total_tasks": 1,
"total_videos": 50,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 50,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lerobot/aloha_sim_transfer_cube_human.PhysicalAI-WorldModel-Synthetic-Digital-Human-Scenes
Dataset Description:
The SDG-SynHuman is a large-scale synthetic video dataset of digital humans rendered in diverse indoor and outdoor 3D environments. The dataset contains 236,937 clips, totaling approximately 5,841 hours of video, and is designed to support training and post-training of NVIDIA Cosmos world foundation models and related physical AI research.
Each sample is a temporally coherent 60-120 second video clip rendered at 1080p and 30 fps. Clips contain… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/PhysicalAI-WorldModel-Synthetic-Digital-Human-Scenes.humanevalplusRoboMIND
RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation
Accepted by Robotics: Science and Systems (RSS) 2025.
📢 ANNOUNCEMENT | RoboMIND V2.0 Release
We're excited to announce the release of RoboMIND V2.0!
🔗 Access the complete RoboMIND V2.0 collection on ModelScope
💾 Overview of RoboMIND 💾
🤖 Composition of RoboMIND 🤖
We present RoboMIND (Multi-embodiment Intelligence Normative Dataset and Benchmark… See the full description on the dataset page: https://huggingface.co/datasets/x-humanoid-robomind/RoboMIND.humanoid-everyday
Humanoid Everyday
A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation
Overview
Humanoid Everyday is a large-scale, diverse humanoid manipulation dataset designed for open-world robotic learning and embodied intelligence.
It contains over 260 tasks across 7 major categories, covering dexterous manipulation, human–humanoid interaction, and locomotion-integrated activities.All data were collected through a human-supervised teleoperation pipeline… See the full description on the dataset page: https://huggingface.co/datasets/USC-PSI-Lab/humanoid-everyday.HumanCellEpigenomeAtlas_sc_allcHumanCellEpigenomeAtlas_sc_contactDECO-50
DECO: Decoupled Multimodal Diffusion Transformer for Bimanual Dexterous Manipulation with a Plugin Tactile Adapter
DECO-50 is a bimanual dexterous manipulation dataset with tactile sensing, comprising 50 hours of teleoperated data across 4 scenarios and 28 subtasks, totaling over 5 million frames collected on real dual-arm robots.
Dataset Structure
DECO-50/
├── task1/
│ ├── sub_task_1/
│ │ ├── episode_000000/
│ │ │ ├──… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-Humanoid/DECO-50.Robo-ValueRL
Robo-ValueRL Dataset
[Project Page] [GitHub] [Model] [Paper]
This repository contains the dataset for Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning.
The Robo-ValueRL dataset provides heterogeneous real-robot experience for studying reliable value estimation, value-guided offline policy pretraining, and online residual adaptation.
Dataset Description
The Robo-ValueRL dataset contains real-robot trajectories collected on two… See the full description on the dataset page: https://huggingface.co/datasets/X-Humanoid/Robo-ValueRL.Medical-Eval-HumanityLastExampaper_Sorrentino_Humanoids2024_Frictionhumanevalpack
Dataset Card for HumanEvalPack
Dataset Summary
HumanEvalPack is an extension of OpenAI's HumanEval to cover 6 total languages across 3 tasks. The Python split is exactly the same as OpenAI's Python HumanEval. The other splits are translated by humans (similar to HumanEval-X but with additional cleaning, see here). Refer to the OctoPack paper for more details.
Languages: Python, JavaScript, Java, Go, C++, Rust
OctoPack🐙🎒:
Data
CommitPack
4TB of GitHub commits… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/humanevalpack.EgoVLA-Humanoid-Simaloha_sim_insertion_human_imageThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "aloha",
"total_episodes": 50,
"total_frames": 25000,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 50,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path": null,
"features": {… See the full description on the dataset page: https://huggingface.co/datasets/lerobot/aloha_sim_insertion_human_image.RoboGene
Dataset Card for RoboGene-Dataset
Figure 1: Overview of the RoboGene dataset.
RoboGene is a large-scale robotic task dataset generated by a diversity-driven agentic framework. Specifically designed for Vision-Language-Action (VLA) model pre-training, it addresses the critical bottlenecks of limited scene variety and insufficient physical grounding in existing datasets, significantly enhancing the generalization capabilities of humanoid robots in complex real-world… See the full description on the dataset page: https://huggingface.co/datasets/X-Humanoid/RoboGene.humanplus-1000
HumanPlus-1000
HumanPlus-1000 is a large-scale multimodal human behavior dataset
designed for learning and modeling human perception, motion, and interaction
in real-world environments.
It captures synchronized egocentric visual observations, full-body motion,
hand motion, camera motion, and 3D environment information, with the goal of
providing paired human perception–action data for embodied intelligence,
human motion modeling, and robotics.
Current Release: This repository… See the full description on the dataset page: https://huggingface.co/datasets/humanplus-ai/humanplus-1000.ArtVIP
ArtVIP dataset card
🎉🎉🎉 ArtVIP is accepted by ICLR 2026
Key Features
✅ 476 high-quality digital-twin articulated objects.
✅ 6 pre-configured digital-twin scenes, 6 user-defined scenes
✅ Reusable Modular interaction
✅ Physics fidelity
✅ Pixel-level affordance annotations
****
Version History… See the full description on the dataset page: https://huggingface.co/datasets/X-Humanoid/ArtVIP.aloha_sim_transfer_cube_human_imageThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.0",
"robot_type": "aloha",
"total_episodes": 50,
"total_frames": 20000,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 50,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path": null,
"features": {… See the full description on the dataset page: https://huggingface.co/datasets/lerobot/aloha_sim_transfer_cube_human_image.SE-167M-Humanhuman_behavior_atlas
Human Behavior Atlas
A large-scale multimodal dataset for human behavior understanding, spanning emotion recognition, sentiment analysis, humor detection, mental health screening, and video question answering. The dataset integrates 16 source datasets into a unified schema with audio, video, and pre-extracted features.
This dataset was used to train OmniSapiens, a foundation model for social behavior processing.
Papers:
Human Behavior Atlas: Benchmarking Unified Psychological and… See the full description on the dataset page: https://huggingface.co/datasets/HumanBehaviorAtlas/human_behavior_atlas.Human-Intelligence-Assurance-Lab
HIA-Bench v0.1
A synthetic evaluation benchmark for emotionally aware, human-centered AI systems.
It contains 100 scenarios across six domains: everyday affect, interpersonal conflict, vulnerability/crisis, dependency risk, epistemic/sycophancy risk, and wellness/biometric interpretation.
The benchmark is designed for evaluation and release assurance. It is not a clinical dataset, does not contain real patient records, and does not establish ground-truth emotional or medical… See the full description on the dataset page: https://huggingface.co/datasets/h0000w/Human-Intelligence-Assurance-Lab.HumanEgo
HumanEgo
HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
🌐 Website ·
📄 Paper ·
💻 Code ·
🎥 Visualization Gallery
Dataset Summary
HumanEgo is a dataset of human egocentric manipulation videos recorded with
Project Aria (Gen 1) glasses, paired with Meta MPS annotations (SLAM trajectories +
hand tracking) and the full HumanEgo preprocessing output — per-frame RGB, object/arm… See the full description on the dataset page: https://huggingface.co/datasets/Leo-TX/HumanEgo.MPII_Human_Pose_Dataset
Dataset Card for MPII Human Pose
MPII Human Pose dataset is a state of the art benchmark for evaluation of articulated human pose estimation.
The dataset includes around 25K images containing over 40K people with annotated body joints.
The images were systematically collected using an established taxonomy of every day human activities.
Overall the dataset covers 410 human activities and each image is provided with an activity label.
Each image was extracted from a YouTube… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/MPII_Human_Pose_Dataset.HumanAndRobot
H&R
Dataset of paper Human2Robot: Learning Robot Actions from Paired Human-Robot Videos (AAAI 2026 Oral)
Data Details
/cam_data
/human_camera: obs of human
/robot_camera: obs of robot
/end_position: eef 6-dof position, [x, y, z, roll, pitch, yaw] represent position and orientation, where the rotation is expressed in Euler angles (degrees) with the order XYZ.
/gripper_state: 0/1, 1 for gripper open，0 for close
/action: This attribute is not available in version v0… See the full description on the dataset page: https://huggingface.co/datasets/dannyXSC/HumanAndRobot.Humanoid-Everyday-H1Xspark-HumanTouch
HumanTouch 数据集发布页
HumanTouch: A Multimodal System for Scalable Human-Hand Tactile Acquisition
运动展示手在做什么，触觉揭示物理世界如何响应。机器人需要理解接触丰富的交互，而不只是模仿运动轨迹。
项目主页：https://xsparkai.com/sparklab/humantouch/
出品机构：SparkLab@Xspark AI
项目负责人：Chuqiao Lyu｜lvcq@xsparkai.com
通讯作者：Wenbo Ding, Tianxing Chen, Qi Xiong
核心贡献：Chenze Yu, Eric J Chen, Wenxuan Zhu
项目成员：Youchen Lai, Raymond Lee, Daniel Li, Kai-Chong Lei, Kehe Ye, Jiahao Zhang, Yuxiao Huo, Xiwen Tan, Weining Lu, Gengqiu Yang, Junhao Gong… See the full description on the dataset page: https://huggingface.co/datasets/chuqiaoLyu/Xspark-HumanTouch.