datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
kitchen-workspace-understanding-safe-manipulation
Kitchen Workspace Understanding & Safe Manipulation
Generated by datapack-import.ts
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under /data; image_path stores the relative repository path and data_commit_sha pins the Hugging Face dataset commit used by those URLs. Files are uploaded as downloaded unless optional PNG recompression is enabled by… See the full description on the dataset page: https://huggingface.co/datasets/physicl/kitchen-workspace-understanding-safe-manipulation.everyday-manipulation-3d-raw
Everyday Manipulation 3D (raw RGB-D)
1,513 clips · 10.28 hours · 279 GiB · 4 participants · 10 manipulation tasks · 42 recording sittings
Chest-mounted iPhone Pro capture of everyday two-handed manipulation by
CaryX AI. Clips were recorded with
Record3D, an iOS app that captures the
iPhone's LiDAR RGB-D stream. Each clip is the app's .r3d recording with the
audio track removed; the sensor streams are unmodified: synchronised RGB,
metric LiDAR depth, per-frame ARKit 6-DoF camera… See the full description on the dataset page: https://huggingface.co/datasets/CaryxAI/everyday-manipulation-3d-raw.ManipulationVQA-60k
Robo2VLM-Reasoning
Samples from the dataset: Robo2VLM-1, prompting gemini-2.5-pro to generate reasoning traces supporting the correct choice.
Paper: Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
@misc{chen2025robo2vlmvisualquestionanswering,
title={Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets},
author={Kaiyuan Chen and Shuangyu Xie and Zehan Ma and Ken Goldberg}… See the full description on the dataset page: https://huggingface.co/datasets/keplerccc/ManipulationVQA-60k.ego-tactile-manipulation
Ego-Tactile Manipulation
Egocentric video + dense two-hand tactile + touch-grounded action labels - by OpenGraph Labs.
Four episodes visualized in our dashboard - egocentric video with live tactile & sensor signals.
Synchronized ego + touch human-manipulation data is rare. This is a clean 1.28-hour sample from OpenGraph Labs' Physical-AI data pipeline: a head camera plus our OGLO tactile gloves on both hands, with action labels derived from the physical contact signal.… See the full description on the dataset page: https://huggingface.co/datasets/OpenGraphLabs-Research/ego-tactile-manipulation.ai-election-manipulation-cases
AI, Elections and Agency Transfer Evidence Index
Version 0.4.4 · released 21 August 2026 · research cutoff 12 August 2026
The dataset contains 6 documented-manipulation records, not 1,087 cases. Read the counts in this order:
1,087 relational rows -> 64 catalogue entries -> 10 core records
-> 8 incident-eligible records
-> 6 documented-manipulation records
The other two incident-eligible records are transparent contested-use… See the full description on the dataset page: https://huggingface.co/datasets/apol/ai-election-manipulation-cases.factory-manipulation-videos
Factory manipulation videos
Procedural Robotics is open sourcing a small set of our factory data so teams can assess its quality. The videos show workers performing factory tasks.
Contents
Seven continuous takes, 109 minutes in total.
Task
Station
Worker
Duration
File
cardboard manipulation
01
041
23.6 min
cardboard_manipulation_station01_worker041.mp4
cardboard manipulation
04
026
16.5 min
cardboard_manipulation_station04_worker026.mp4
defect… See the full description on the dataset page: https://huggingface.co/datasets/procedural-robotics/factory-manipulation-videos.image-manipulation-dataset-compilation1000_Robot_Manipulation_Tasks
1000 Robot Manipulation Tasks
This dataset is currently undergoing a phased upload process. Due to its substantial size, the complete data is being incrementally published to ensure stability and integrity during transmission. We appreciate your patience as we finalize the full availability of the dataset.
This dataset is distributed under the MIT License. This permissive free software license grants users the freedom to use, copy, modify, merge, publish, distribute, sublicense… See the full description on the dataset page: https://huggingface.co/datasets/PitVit/1000_Robot_Manipulation_Tasks.manipulation-init-frame-descriptions
Manipulation init-frame / description pairs
1000 (init frame image, task description) pairs randomly sampled
(seed=42) from the manipulation task family of
nvidia/PhysicalAI-WorldModel-Synthetic-Embodied-Robot-Scenes.
Each row is the first frame of a simulated manipulation clip paired with its
task description text, drawn from the following generators within the
manipulation task family: DreamZero, MimicGen (AgiBot G1 / Fourier GR-1 /
Galbot G1), and Simulario.
Columns:… See the full description on the dataset page: https://huggingface.co/datasets/khang123452/manipulation-init-frame-descriptions.egocentric-manipulation-sample
SmartDeer — Egocentric Human Demonstration Data (Public Sample)
SmartDeer collects egocentric human demonstration data for embodied AI: real operators, real tasks, real environments. No teleoperation rigs, no lab mock-ups, no actors.
This repository is a small public sample, published so you can inspect our capture quality, annotation schema and file conventions. Production data is delivered under commercial terms.
This sample
Task twist_cap — bimanual bottle-cap… See the full description on the dataset page: https://huggingface.co/datasets/SmartDeer/egocentric-manipulation-sample.PaperBench-X-Embodied-Manipulation-Pi05-LIBERO
PaperBench-X — pi05 / LIBERO
Standalone embodied manipulation public-demo package for the released openpi
pi05_libero checkpoint on all four LIBERO suites. This repository intentionally
contains no navigation tasks and is not the general manipulation bundle.
What is here
path
content
task/
complete Harbor task, evaluator, rubric, scoring regression tests and report builder
raw_task/
canonical source used by convert_raw_to_rp.py
demo/
static… See the full description on the dataset page: https://huggingface.co/datasets/SueMintony/PaperBench-X-Embodied-Manipulation-Pi05-LIBERO.door-opening-manipulation-training-pack-next-pack-fbe147bb-03e76805
Outdoor Door Handle Push/Pull Training Set
Synthetic outdoor dataset staged in an alleyway to train a robot to detect door handles and determine whether a door must be pushed or pulled. 20 renders at 1024x1024 with albedo and metric depth passes, per-frame annotations, and authored lighting.
This dataset mirrors public data-pack render outputs from Physicl.
Each row represents one render view. The image column contains a stable URL to the primary render image uploaded under… See the full description on the dataset page: https://huggingface.co/datasets/physicl-community/door-opening-manipulation-training-pack-next-pack-fbe147bb-03e76805.robotic-manipulation-dataset
Robotic Manipulation Dataset
This dataset contains multimodal data collected from real-world robotic manipulation tasks using a D435 depth camera and additional sensors. It is intended to support research in robot learning, perception, manipulation planning, and imitation learning.
Usage Examlpes
For usage examples, evaluation metrics, and fine-tuning code on this dataset, please refer to:
Robotic Action Frame Prediction
📁 Dataset Structure
The dataset is… See the full description on the dataset page: https://huggingface.co/datasets/yutengz/robotic-manipulation-dataset.kitchen-object-grasping-manipulation-policy-training-next-pack-5534d90d-f7cb0d04
Cluttered Home Kitchens for Cooking-Assistant Robot
Training dataset of richly cluttered, realistic home kitchens to train a YOLOv8-based cooking-assistant robot that navigates the kitchen, detects and segments objects, distinguishes food from non-food, identifies what needs cleaning, avoids obstacles and manipulates objects. Renders are 640x640 with metric depth, world-space normals (OpenGL linear), albedo and material-index passes, per-frame annotations, and midday lighting… See the full description on the dataset page: https://huggingface.co/datasets/physicl-community/kitchen-object-grasping-manipulation-policy-training-next-pack-5534d90d-f7cb0d04.selfapr-manipulation-bug-error-context-allrobotic-arm-manipulation-samples
Robotic Arm Manipulation Samples
This sample shows robotic arm manipulation episodes for reviewing object interaction, camera framing, and task-level metadata before scoping a larger robotics dataset.
What This Shows
Pick-and-place and object manipulation sequences
Video samples paired with task and capture metadata
Signals useful for evaluating scene setup, object diversity, and action structure
Dataset Specifications
Field
Value… See the full description on the dataset page: https://huggingface.co/datasets/psdn-ai/robotic-arm-manipulation-samples.bag-all-0-robot-manipulation-v3-working
Bag All 0 Robot Manipulation Dataset (v3.0 Working)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:32:15
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └── file-000.parquet
videos/
├── observation.images.front/
│… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-v3-working.bag-all-0-robot-manipulation-exact-format
Bag All 0 Robot Manipulation Dataset (Exact Format)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:35:54
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └── file-000.parquet
videos/
├── observation.images.front/
│… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-exact-format.bag-all-0-robot-manipulation-ultra-final-working-v3
Bag All 0 Robot Manipulation Dataset (Ultra Final Working v3.0)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:34:27
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └── file-000.parquet
videos/
├──… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-ultra-final-working-v3.bag-all-0-robot-manipulation-compatible-format
Bag All 0 Robot Manipulation Dataset (Compatible Format)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format with compatible Hugging Face dataset format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:40:37
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └──… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-compatible-format.thinking_berkeley_fanuc_manipulation_lerobot_output_qwen3vlbag-all-0-robot-manipulation-final-working-v3
Bag All 0 Robot Manipulation Dataset (Final Working v3.0)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:33:16
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └── file-000.parquet
videos/
├── observation.images.front/… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-final-working-v3.bag-all-0-robot-manipulation-complete-format
Bag All 0 Robot Manipulation Dataset (Complete Format)
This dataset contains robot manipulation data converted from bag_all_0.db3 to LeRobot v3.0 format.
Dataset Information
Format: LeRobot v3.0
Codebase Version: v3.0
Created: 2025-09-08 15:38:31
Task: Pick and Place manipulation
Source: bag_all_0.db3
Compatible with: LeRobot Visualization Tool
Dataset Structure
data/
├── chunk-000/
│ └── file-000.parquet
videos/
├── observation.images.front/
│… See the full description on the dataset page: https://huggingface.co/datasets/Sraghvi/bag-all-0-robot-manipulation-complete-format.manipulation-resistant-prompts-1536-1536
Dataset Card: manipulation-resistant-prompts-1536-1536
Dataset Description
This dataset contains prompts with specified target word counts for both input prompts and target outputs, designed to test and evaluate language models across different length requirements. Word counts are defined as whitespace-separated tokens, providing a consistent and human-interpretable measure of text length.
These datasets are typically used in performance benchmarking of language models… See the full description on the dataset page: https://huggingface.co/datasets/metrum-ai/manipulation-resistant-prompts-1536-1536.Safe-Mobile-Manipulation
Introspective Planning: Aligning Robots’ Uncertainty with Inherent Task Ambiguity
🌐 Project Page | 📄 Paper | GitHub
Overview
Safe Mobile Manipulation dataset was designed to evaluate Large Language Models' (LLMs) capability to reason effectively about both uncertainty and safety in mobile manipulation tasks. The dataset comprises 500 total scenarios: 100 scenarios in the test set, 200 scenarios for knowledge base construction, and 200 scenarios for conformal calibration.… See the full description on the dataset page: https://huggingface.co/datasets/kaiquliang/Safe-Mobile-Manipulation.manipulation-resistant-prompts-1536-96
Dataset Card: manipulation-resistant-prompts-1536-96
Dataset Description
This dataset contains prompts with specified target word counts for both input prompts and target outputs, designed to test and evaluate language models across different length requirements. Word counts are defined as whitespace-separated tokens, providing a consistent and human-interpretable measure of text length.
These datasets are typically used in performance benchmarking of language models… See the full description on the dataset page: https://huggingface.co/datasets/metrum-ai/manipulation-resistant-prompts-1536-96.manipulations_multi
Dataset Card for "manipulations_multi"
More Information needed
manipulation-resistant-prompts-96-96
Dataset Card: manipulation-resistant-prompts-96-96
Dataset Description
This dataset contains prompts with specified target word counts for both input prompts and target outputs, designed to test and evaluate language models across different length requirements. Word counts are defined as whitespace-separated tokens, providing a consistent and human-interpretable measure of text length.
These datasets are typically used in performance benchmarking of language models, where… See the full description on the dataset page: https://huggingface.co/datasets/metrum-ai/manipulation-resistant-prompts-96-96.personality_manipulationmultimodal-human-manipulation-6000h
Multimodal Human Manipulation Dataset
6,000 hours of sensor-rich human manipulation demonstrations: egocentric and external video, RGB-D, motion capture, IMU, hand pose, object labels, task phases, and interaction annotations for Physical AI and robotics.
This repository is a specification and preview listing. The production dataset is rights-cleared and delivered directly to buyers. Request access to see the full schema and get real multi-sensor samples.
Overview… See the full description on the dataset page: https://huggingface.co/datasets/DatoricAI/multimodal-human-manipulation-6000h.