Team Ai
Datasetpublic

LeWAM/lewam_eval_pnpt_diffusion_wide

This dataset was created using LeRobot. Dataset Description Real-robot evaluation rollouts recorded on a Rebot B601 7-DoF arm, from the LeWAM project. Every episode here is a policy rollout on the physical robot — not a teleoperated demonstration — scored by a human operator immediately after it ran. Task: pick-and-place (b601_pnpt): the arm picks a roll of tape and places it on a target. Trained on LeWAM/b601_pusht_pick_and_place. Policy: a LeRobot Diffusion Policy… See the full description on the dataset page: https://huggingface.co/datasets/LeWAM/lewam_eval_pnpt_diffusion_wide.

sourceHugging Faceapache-2.0updated 5d agoView on Hugging Face
0likes112downloads
Dataset Card

This dataset was created using LeRobot.

<a class="flex" href="https://huggingface.co/spaces/lerobot/visualizedataset?path=LeWAM/lewamevalpnptdiffusion_wide"> <img class="block dark:hidden" src="https://huggingface.co/datasets/huggingface/badges/resolve/main/visualize-this-dataset-xl.svg"/> <img class="hidden dark:block" src="https://huggingface.co/datasets/huggingface/badges/resolve/main/visualize-this-dataset-xl-dark.svg"/> </a>

Dataset Description

Real-robot evaluation rollouts recorded on a Rebot B601 7-DoF arm, from the LeWAM project. Every episode here is a policy rollout on the physical robot — not a teleoperated demonstration — scored by a human operator immediately after it ran.

  • —Task: pick-and-place (b601_pnpt): the arm picks a roll of tape and places it on a target. Trained on `LeWAM/b601_pusht_pick_and_place`.
  • —Policy: a LeRobot Diffusion Policy (horizon=40, n_action_steps=36, n_obs_steps=2, widened to down_dims=[336, 672, 1344]), predicting an action chunk only
  • —Success rate: 19/30 = 63.3%
  • —Episodes: 30 · frames: 10447 · fps: 30 · robot time: 5.8 min
  • —Wall-clock: 19.3 min (median 31s, max 87s per episode) — longer than robot time because inference on this hardware runs slower than real time
  • —wandb run: `nuby2195` (eval-pnpt_diffusion_wide)
  • —Episode cap: 5400 steps — an episode that hits it is scored a failure.

Observations

Three synchronised camera streams (observation.images.zed_left, observation.images.zed_right from a ZED Mini, observation.images.wrist_cam from a wrist-mounted USB camera) plus observation.state. action is the 7-DoF joint command the policy emitted.

Note the policies were served torque-only state (observation.state sliced to *.torq); the observation.state recorded here is the robot's full state vector, so reproducing what the policy actually saw means applying the same slice.

Per-episode scoring

eval_session.json holds the operator's label for each episode:

episodesuccessstepsseconds
0✅20022.0
1✅20021.6
2❌45044.1
3✅56056.5
4✅21825.5
5❌83987.3
6✅18222.0
7✅38041.5
8❌23627.8
9✅18221.0
10❌45249.3
11✅20023.4
12❌45250.0
13✅32137.0
14✅23025.9
15❌31635.9
16❌52459.6
17✅53158.9
18❌27130.7
19✅20023.6
20✅19323.2
21✅41648.3
22❌60267.7
23✅20024.0
24✅18222.2
25❌68677.3
26✅20124.5
27❌65364.2
28✅18219.7
29✅21823.5
  • —Homepage: https://github.com/erykhalicki/LeWAM
  • —Paper: [More Information Needed]
  • —License: apache-2.0

Dataset Structure

meta/info.json:

json
{
    "codebase_version": "v3.0",
    "fps": 30,
    "features": {
        "observation.state": {
            "dtype": "float32",
            "shape": [
                21
            ],
            "names": [
                "shoulder_pan.pos",
                "shoulder_lift.pos",
                "elbow_flex.pos",
                "wrist_flex.pos",
                "wrist_yaw.pos",
                "wrist_roll.pos",
                "gripper.pos",
                "shoulder_pan.torq",
                "shoulder_lift.torq",
                "elbow_flex.torq",
                "wrist_flex.torq",
                "wrist_yaw.torq",
                "wrist_roll.torq",
                "gripper.torq",
                "shoulder_pan.vel",
                "shoulder_lift.vel",
                "elbow_flex.vel",
                "wrist_flex.vel",
                "wrist_yaw.vel",
                "wrist_roll.vel",
                "gripper.vel"
            ]
        },
        "observation.images.zed_left": {
            "dtype": "video",
            "shape": [
                376,
                672,
                3
            ],
            "names": [
                "height",
                "width",
                "channels"
            ],
            "info": {
                "is_depth_map": false,
                "video.height": 376,
                "video.width": 672,
                "video.codec": "h264",
                "video.pix_fmt": "yuv420p",
                "video.fps": 30,
                "video.channels": 3,
                "has_audio": false,
                "video.g": 2,
                "video.crf": 30,
                "video.preset": null,
                "video.fast_decode": 0,
                "video.video_backend": "pyav",
                "video.extra_options": {}
            }
        },
        "observation.images.zed_right": {
            "dtype": "video",
            "shape": [
                376,
                672,
                3
            ],
            "names": [
                "height",
                "width",
                "channels"
            ],
            "info": {
                "is_depth_map": false,
                "video.height": 376,
                "video.width": 672,
                "video.codec": "h264",
                "video.pix_fmt": "yuv420p",
                "video.fps": 30,
                "video.channels": 3,
                "has_audio": false,
                "video.g": 2,
                "video.crf": 30,
                "video.preset": null,
                "video.fast_decode": 0,
                "video.video_backend": "pyav",
                "video.extra_options": {}
            }
        },
        "observation.images.wrist_cam": {
            "dtype": "video",
            "shape": [
                360,
                640,
                3
            ],
            "names": [
                "height",
                "width",
                "channels"
            ],
            "info": {
                "is_depth_map": false,
                "video.height": 360,
                "video.width": 640,
                "video.codec": "h264",
                "video.pix_fmt": "yuv420p",
                "video.fps": 30,
                "video.channels": 3,
                "has_audio": false,
                "video.g": 2,
                "video.crf": 30,
                "video.preset": null,
                "video.fast_decode": 0,
                "video.video_backend": "pyav",
                "video.extra_options": {}
            }
        },
        "action": {
            "dtype": "float32",
            "shape": [
                7
            ],
            "names": [
                "shoulder_pan.pos",
                "shoulder_lift.pos",
                "elbow_flex.pos",
                "wrist_flex.pos",
                "wrist_yaw.pos",
                "wrist_roll.pos",
                "gripper.pos"
            ]
        },
        "timestamp": {
            "dtype": "float32",
            "shape": [
                1
            ],
            "names": null
        },
        "frame_index": {
            "dtype": "int64",
            "shape": [
                1
            ],
            "names": null
        },
        "episode_index": {
            "dtype": "int64",
            "shape": [
                1
            ],
            "names": null
        },
        "index": {
            "dtype": "int64",
            "shape": [
                1
            ],
            "names": null
        },
        "task_index": {
            "dtype": "int64",
            "shape": [
                1
            ],
            "names": null
        }
    },
    "total_episodes": 30,
    "total_frames": 10447,
    "total_tasks": 1,
    "chunks_size": 1000,
    "data_files_size_in_mb": 100,
    "video_files_size_in_mb": 200,
    "data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
    "video_path": "videos/{video_key}/chunk-{chunk_index:03d}/file-{file_index:03d}.mp4",
    "robot_type": null,
    "splits": {
        "train": "0:30"
    }
}

Citation

BibTeX:

bibtex
[More Information Needed]