InternRobotics/VLAC-Cut-Benchmark
Video Progress Benchmark Paper · Code · Model · Benchmark Overview The Video Progress Benchmark (VPB) evaluates process-level task progress estimation for robot manipulation. It measures whether a model can capture advancement, stagnation, regression, and recovery throughout an execution video. VPB is built from the held-out portion of the Progress Annotation Dataset. Unlike endpoint-only evaluations, VPB focuses on temporal task progress and supports analysis… See the full description on the dataset page: https://huggingface.co/datasets/InternRobotics/VLAC-Cut-Benchmark.
Update HELP citation
Update VPB card header
Refine VPB dataset card style
Update VPB citation
Update VPB dataset card links
Update VPB dataset card
Restructure benchmark release
Make VPB public evaluation strict by default
Update benchmark README
Fix frame extraction view deduplication
Add VLAC-Cut public benchmark evaluation workflow
Clarify VLAC-Cut evaluation workflow and metrics
Update public VPB evaluator and VLAC-Cut evaluation docs
Delete old unpack script name
Rename archive unpack script
Refine README and rename unpack script
Document custom frame output root
Support custom frame output root
Simplify README and clarify frame extraction paths
Refine README academic wording
Refine README style for Video-Progress Benchmark release
Rename benchmark README to Video-Progress Benchmark
Finalize simplified release interface for scripts/extract_vlac2_release_frames.py
Finalize simplified release interface for scripts/extract_vlac2_release_raw_archives.sh
Finalize simplified release interface for README.md
Update scripts/vlac2_release_common.py for direct data extraction layout
Update scripts/extract_vlac2_release_frames.py for direct data extraction layout
Update README.md for direct data extraction layout
Rename benchmark release layout to benchmark_splits and data
Add files using upload-large-folder tool
Add files using upload-large-folder tool
Update scripts/extract_vlac2_release_raw_archives.sh
Update README.md
Update benchmark_data/train/video_progress_benchmark_file.json for __VLAC2_FRAMES_ROOT__ placeholder
Update benchmark_data/test_nonexpert_unseen/video_progress_benchmark_file.json for __VLAC2_FRAMES_ROOT__ placeholder
Update benchmark_data/test_nonexpert_seen/video_progress_benchmark_file.json for __VLAC2_FRAMES_ROOT__ placeholder
Update benchmark_data/test_expert_unseen/video_progress_benchmark_file.json for __VLAC2_FRAMES_ROOT__ placeholder
Update benchmark_data/test_expert_seen/video_progress_benchmark_file.json for __VLAC2_FRAMES_ROOT__ placeholder
Update scripts/vlac2_release_common.py for __VLAC2_FRAMES_ROOT__ placeholder
Update README.md for __VLAC2_FRAMES_ROOT__ placeholder
Update benchmark_data/train/video_progress_benchmark_file.json
Update benchmark_data/test_nonexpert_unseen/video_progress_benchmark_file.json
Update benchmark_data/test_nonexpert_seen/video_progress_benchmark_file.json
Update benchmark_data/test_expert_unseen/video_progress_benchmark_file.json
Update benchmark_data/test_expert_seen/video_progress_benchmark_file.json
Update scripts/vlac2_release_common.py
Update scripts/extract_vlac2_release_frames.py
Update README.md
Delete benchmark_json/train/video_progress_benchmark_file.json
Delete benchmark_json/test_nonexpert_unseen/video_progress_benchmark_file.json