datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
kitchen-workspace-understanding-safe-manipulation
Kitchen Workspace Understanding & Safe Manipulation
Generated by datapack-import.ts
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under /data; image_path stores the relative repository path and data_commit_sha pins the Hugging Face dataset commit used by those URLs. Files are uploaded as downloaded unless optional PNG recompression is enabled by… See the full description on the dataset page: https://huggingface.co/datasets/physicl/kitchen-workspace-understanding-safe-manipulation.warehouse-manipulation-and-states
Warehouse Manipulation & States
Try it before you download. Every item in this dataset is live in
projectsim Lab: drag the box flaps, roll the cage casters, then copy the API call that generates a set like it.
Jump straight to a class: Boxes · Cages · Pallet Boxes.
Procedurally generated, sim-ready 3D warehouse assets - cardboard boxes,
pallet-and-box stacks, and wire logistics cages - shipped as OpenUSD (.usda)
and MuJoCo XML (.xml, MJCF) with per-zone PBR maps… See the full description on the dataset page: https://huggingface.co/datasets/projectsim/warehouse-manipulation-and-states.ManipulationVQA-60k
Robo2VLM-Reasoning
Samples from the dataset: Robo2VLM-1, prompting gemini-2.5-pro to generate reasoning traces supporting the correct choice.
Paper: Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
@misc{chen2025robo2vlmvisualquestionanswering,
title={Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets},
author={Kaiyuan Chen and Shuangyu Xie and Zehan Ma and Ken Goldberg}… See the full description on the dataset page: https://huggingface.co/datasets/keplerccc/ManipulationVQA-60k.manipulation_data_3This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 2926,
"total_frames": 1096588,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 3,
"chunks_size": 1000,
"fps": 20,
"splits": {
"train": "0:2926"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lqs2015/manipulation_data_3.image-manipulation-dataset-compilationmanipulation-init-frame-descriptions
Manipulation init-frame / description pairs
1000 (init frame image, task description) pairs randomly sampled
(seed=42) from the manipulation task family of
nvidia/PhysicalAI-WorldModel-Synthetic-Embodied-Robot-Scenes.
Each row is the first frame of a simulated manipulation clip paired with its
task description text, drawn from the following generators within the
manipulation task family: DreamZero, MimicGen (AgiBot G1 / Fourier GR-1 /
Galbot G1), and Simulario.
Columns:… See the full description on the dataset page: https://huggingface.co/datasets/khang123452/manipulation-init-frame-descriptions.Tactile_Manipulation_Dataset
Dataset for Tactile Manipulation Tasks
Acknowledgements
The USD and calibration assets of Franka Panda with tactile sensor GelsightMini are from TacEx.
bedroom-tidying-robot-manipulation-training-set-next-pack-93682a70-a19b80d2
Bedroom furniture perception — attic & flat-ceiling rooms
Training datapack to improve a robot perception model on bedroom scenes furnished with a double bed, two nightstands, a dressing table and a wardrobe, across two configurations: attic/sloped-ceiling bedrooms (skylight windows) and flat-ceiling bedrooms. 30 renders at 1024x1024 with RGB plus albedo, metric depth and world-space OpenGL normals, per-frame annotations enabled and each environment's authored lighting. Supports… See the full description on the dataset page: https://huggingface.co/datasets/physicl-community/bedroom-tidying-robot-manipulation-training-set-next-pack-93682a70-a19b80d2.franka-fr3-manipulationThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "franka",
"total_episodes": 101,
"total_frames": 21006,
"total_tasks": 4,
"chunks_size": 1000,
"fps": 8,
"splits": {
"train": "0:101"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4"… See the full description on the dataset page: https://huggingface.co/datasets/binsabit/franka-fr3-manipulation.Chinese_Commercial_Kitchen_Manipulation_Dataset_Preview
🍳 Chinese Commercial Kitchen Manipulation Dataset — Sample Pack v0.1
Asia's first real commercial kitchen manipulation dataset.Professional chef (20 years) · Real restaurant environment · Multi-view RGB-D · Egocentric video
📧 Request evaluation samples or full data: andy@dynamicnova.com
Overview
This sample pack contains real-world cooking demonstrations collected in an operating Chinese commercial kitchen in Zhongshan, Guangdong, China.
The data focuses on… See the full description on the dataset page: https://huggingface.co/datasets/nova-dynamics/Chinese_Commercial_Kitchen_Manipulation_Dataset_Preview.puzzle_manipulation_datasets
Puzzle Manipulation Datasets
This dataset is a collection of logged data from the teleoperation of ergoCub manipulating a puzzle.
Dataset Details
Dataset Description
This dataset contains data from the teleoperation of ergoCub collected in an experiment where the robot first unsolves then solves a puzzle.
Curated by: Giovanni Fregonese (@giotherobot)
License: CC BY 4.0
Dataset Creation
Curation Rationale
The dataset was created… See the full description on the dataset page: https://huggingface.co/datasets/ami-iit/puzzle_manipulation_datasets.PaperBench-X-Embodied-Manipulation-Pi05-LIBERO
PaperBench-X — pi05 / LIBERO
Standalone embodied manipulation public-demo package for the released openpi
pi05_libero checkpoint on all four LIBERO suites. This repository intentionally
contains no navigation tasks and is not the general manipulation bundle.
What is here
path
content
task/
complete Harbor task, evaluator, rubric, scoring regression tests and report builder
raw_task/
canonical source used by convert_raw_to_rp.py
demo/
static… See the full description on the dataset page: https://huggingface.co/datasets/SueMintony/PaperBench-X-Embodied-Manipulation-Pi05-LIBERO.manipulation_datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 755,
"total_frames": 437145,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 20,
"splits": {
"train": "0:755"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lqs2015/manipulation_dataset.GR1-Manipulation-IsaacSim-Rendered
GR1 Manipulation — Isaac Sim Rendered Dataset
Dataset Description
Multi-modal rendered dataset of NVIDIA GR1 humanoid robot performing tabletop manipulation tasks
in Isaac Sim. Each episode is rendered as 3 synchronized MP4 videos:
RGB — ray-traced color video
Depth — normalized depth map (grayscale, 0–10m range)
Segmentation — semantic segmentation with per-object class coloring
This dataset is designed as input for NVIDIA Cosmos Transfer 2.5 to generate photorealistic… See the full description on the dataset page: https://huggingface.co/datasets/khang123452/GR1-Manipulation-IsaacSim-Rendered.door-opening-manipulation-training-pack-next-pack-fbe147bb-03e76805
Outdoor Door Handle Push/Pull Training Set
Synthetic outdoor dataset staged in an alleyway to train a robot to detect door handles and determine whether a door must be pushed or pulled. 20 renders at 1024x1024 with albedo and metric depth passes, per-frame annotations, and authored lighting.
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under… See the full description on the dataset page: https://huggingface.co/datasets/physicl-community/door-opening-manipulation-training-pack-next-pack-fbe147bb-03e76805.kitchen-object-grasping-manipulation-policy-training-next-pack-5534d90d-f7cb0d04
Cluttered Home Kitchens for Cooking-Assistant Robot
Training dataset of richly cluttered, realistic home kitchens to train a YOLOv8-based cooking-assistant robot that navigates the kitchen, detects and segments objects, distinguishes food from non-food, identifies what needs cleaning, avoids obstacles and manipulates objects. Renders are 640x640 with metric depth, world-space normals (OpenGL linear), albedo and material-index passes, per-frame annotations, and midday lighting… See the full description on the dataset page: https://huggingface.co/datasets/physicl-community/kitchen-object-grasping-manipulation-policy-training-next-pack-5534d90d-f7cb0d04.manipulation
Dataset Card for ContextShift
ContextShift is a controlled benchmark for evaluating how object detectors respond to systematic image manipulations that alter object appearance and geometry, the geometric relationship between an object and its surroundings, or scene background. Built from COCO 2017 validation images, it includes two pre-built manipulation families—geometric transformations and synthetic background replacement—and one in-pipeline analysis based on NPMI-guided… See the full description on the dataset page: https://huggingface.co/datasets/contextshift/manipulation.manipulation_dataset_2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "panda",
"total_episodes": 1779,
"total_frames": 1030041,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 2,
"chunks_size": 1000,
"fps": 20,
"splits": {
"train": "0:1779"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/lqs2015/manipulation_dataset_2.genai-manipulation-detection-interior
GenAI Manipulation Detection Dataset - Interior Design Images
📋 Dataset Description
This dataset contains 1000 paired images (real + manipulated) for training and evaluating GenAI manipulation detection models. Created for the MenaML Winter School 2026 Hackathon.
Dataset Summary
Total Images: 1000 pairs (2000 total images)
Image Size: 512x512
Format: JPEG
Source: Pinterest Interior Design Images (Kaggle)
License: MIT
🎯 Challenge Context
This… See the full description on the dataset page: https://huggingface.co/datasets/FatimahEmadEldin/genai-manipulation-detection-interior.thinking_berkeley_fanuc_manipulation_lerobot_output_qwen3vladamanip_manipulationpanorama-mobile-manipulation
Panorama Mobile Manipulation
This dataset contains four panorama manipulation tasks packaged as a single
Hugging Face dataset repo with one subdirectory per task.
Overview
Dataset format: lerobot dataset
Codebase version: v2.1
Frame rate: 27 FPS
Total tasks: 4
Total episodes: 802
Total frames: 544,773
Videos: none
Task Subsets
Folder
Task
Episodes
Frames
pano_mobile_manipulation_move_pen
Place the pen to the pen case.
201
78,885… See the full description on the dataset page: https://huggingface.co/datasets/puffyyy/panorama-mobile-manipulation.labutopia_level5_mobile_manipulation_20260825octo_berkeley_fanuc_manipulationForensic-Manipulation-Test-Setnon-prehensile-manipulationimage_manipulation3D-manipulations-datasetmanipulation_planning_image