datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ActivityNet1fpsunsupervised_peoples_speech_raw_voice_activity_detection_snippets_part_1Hand-action-videos中文 README
✋ Hand Action Video Dataset
✋ Hand Action Video Dataset
This dataset is a real-world video dataset focused on hand actions (Hand Action Video Dataset), with an emphasis on common operations in hand–object interaction scenarios. It contains a large number of videos featuring:
✋ Clean and clear hand actions
🧱 Explicit hand–object interaction relationships
The dataset is constructed via video retrieval on **Datacube ** combined with automatic filtering using multimodal… See the full description on the dataset page: https://huggingface.co/datasets/BAAI-DataCube/Hand-action-videos.video_chatgpt_activitynet_videosgui_actor_webdataset
GUI-Actor WebDataset
A WebDataset format version of the GUI-Actor dataset for training vision-language models on GUI interaction tasks.
Usage
import webdataset as wds
# Load the dataset
dataset = wds.WebDataset("path/to/shards-*.tar")
dataset = dataset.decode("pilrgb").to_tuple("jpg", "json")
for image, metadata in dataset:
# Process image and metadata
pass
Citation
Please cite the original GUI-Actor paper if you use this dataset in your research.
robotwin-act
MetaAct / Robotwin ACT
This repository hosts the public release artifacts for the MetaAct Robotwin ACT project.
Files
File
Size
SHA256
Data/robotwin-act-data.tar.gz.part001 - Data/robotwin-act-data.tar.gz.part007
128,050,721,979 bytes total
6B10200A8800B70700084F9437175151886D349B1270A4A659172F0C548A6284 after merge
Docker image archives for the same release will be added to this repository later.
Download
Install the Hugging Face… See the full description on the dataset page: https://huggingface.co/datasets/MetaAct/robotwin-act.activations_key_door_env_100
Key & Door Trajectory Activations for Probe Testing
The activations were generated as follows using the interp-cli from https://github.com/SPAR-Telos/interp:
TRAJECTORY_DIR="trajectories_key_door_env_100/trajectories"
OUTPUT_DIR="activations_key_door_env_100"
# Extraction parameters
LAYERS="7,15,23"
STEPS="all"
PROMPT_SUFFIX_INDICES="-3:-1"
OUTPUT_INDICES="-16:-14"
CUDA_VISIBLE_DEVICES=0 interp-cli gather_activations \
--trajectory-paths "$SIZE_DIR/*.json" \… See the full description on the dataset page: https://huggingface.co/datasets/project-telos/activations_key_door_env_100.ActivityNet-FOIL_video_feats.tardroid-latent-shards-v1-4-commanded-actionactivations_test_full
Full Trajectory Activations for Probe Testing
The activations were generated as follows using the interp-cli from https://github.com/SPAR-Telos/interp:
TRAJECTORY_DIR="trajectories_test_full"
OUTPUT_DIR="activations_test_full"
# Extraction parameters
LAYERS="7,15,23"
STEPS="all"
PROMPT_SUFFIX_INDICES="-3:-1"
OUTPUT_INDICES="-16:-14"
for SIZE_DIR in "$TRAJECTORY_DIR"/size*; do
CUDA_VISIBLE_DEVICES=0 interp-cli gather_activations \
--trajectory-paths "$SIZE_DIR/*.json"… See the full description on the dataset page: https://huggingface.co/datasets/project-telos/activations_test_full.activations_train_single_step
Single-step Activations for Probe Training
The activations were generated as follows using the interp-cli from https://github.com/SPAR-Telos/interp:
TRAJECTORY_DIR="trajectories_train_single_step"
OUTPUT_DIR="activations_train_single_step"
# Extraction parameters
LAYERS="7,15,23"
STEPS="0"
PROMPT_SUFFIX_INDICES="-3:-1"
OUTPUT_INDICES="-16:-14"
for SIZE_DIR in "$TRAJECTORY_DIR"/size*; do
CUDA_VISIBLE_DEVICES=0 interp-cli gather_activations \
--trajectory-paths… See the full description on the dataset page: https://huggingface.co/datasets/project-telos/activations_train_single_step.doom-actions-gemini-botcounterfactual-activationsaction_realestateextracted-activationsanimal_activationsactivitynetactvoice-acting-promptsworldedit_action_filtered