Datasetpublic

UnrealMLLM/realistic_scen

Unreal MLLM Dataset - realistic_scen Physics simulation dataset with unreal rules for multimodal language model evaluation. Dataset Structure Each row contains: Video file with physics simulation Plan and metadata as JSON strings Multiple QA items (Rule Identification, Explanatory Reasoning, Predictive) Optional prediction video Features features: - name: difficulty dtype: string - name: file_name dtype: video - name: id dtype:… See the full description on the dataset page: https://huggingface.co/datasets/UnrealMLLM/realistic_scen.

sourceHugging Facemitupdated 9mo agoView on Hugging Face

0likes354downloads

Dataset Card

Unreal MLLM Dataset - realistic_scen

Physics simulation dataset with unreal rules for multimodal language model evaluation.

Dataset Structure

Each row contains:

—Video file with physics simulation
—Plan and metadata as JSON strings
—Multiple QA items (Rule Identification, Explanatory Reasoning, Predictive)
—Optional prediction video

Features

yaml

features:
  - name: difficulty
    dtype: string
  - name: file_name
    dtype: video
  - name: id
    dtype: string
  - name: metadata
    dtype: string
  - name: plan
    dtype: string
  - name: prediction_file_name
    dtype: video
  - name: q1_correct_answers
    dtype: string
  - name: q1_options
    dtype: string
  - name: q1_question
    dtype: string
  - name: q1_type
    dtype: string
  - name: q2_correct_answer
    dtype: string
  - name: q2_question
    dtype: string
  - name: q2_type
    dtype: string
  - name: q3_correct_answers
    dtype: string
  - name: q3_options
    dtype: string
  - name: q3_question
    dtype: string
  - name: q3_type
    dtype: string
  - name: q4_correct_answers
    dtype: string
  - name: q4_options
    dtype: string
  - name: q4_question
    dtype: string
  - name: q4_type
    dtype: string
  - name: rules
    dtype: string
  - name: scenario_name
    dtype: string
  - name: uuid
    dtype: string

Usage

python

from datasets import load_dataset

ds = load_dataset("UnrealMLLM/realistic_scen")

License

MIT