Datasetpublic

gfcfirefly/AV-QuantBench-Dataset

AV-QuantBench AV-QuantBench is a procedural audio-visual benchmark for evaluating multimodal foundation models on abstract temporal reasoning, cross-modal conflict detection, and synchronized data interpretation across finance, medical, and industrial domains. This Hugging Face dataset repository is structured as a benchmark-style release. It contains: split metadata in JSONL format, question-answer annotations, audio-visual sample assets, manifest files by domain, and… See the full description on the dataset page: https://huggingface.co/datasets/gfcfirefly/AV-QuantBench-Dataset.

sourceHugging Facecc-by-nc-4.0updated 7mo agoView on Hugging Face

0likes35downloads

Dataset Card

AV-QuantBench

AV-QuantBench is a procedural audio-visual benchmark for evaluating multimodal foundation models on abstract temporal reasoning, cross-modal conflict detection, and synchronized data interpretation across finance, medical, and industrial domains.

This Hugging Face dataset repository is structured as a benchmark-style release. It contains:

—split metadata in JSONL format,
—question-answer annotations,
—audio-visual sample assets,
—manifest files by domain,
—and documentation for schema and responsible use.

The repository is organized so that newly generated benchmark outputs can be added with minimal restructuring. In particular, the samples/ directory follows the same domain-first layout as the AV-QuantBench generator outputs.

Dataset Summary

AV-QuantBench converts time-series signals into synchronized visual topology and acoustic momentum. Each sample is paired with machine-generated QA derived from deterministic state-machine triggers. The benchmark is designed to evaluate whether a model can jointly reason over audio and video when the two modalities either align or intentionally diverge.

Supported Tasks

—Cross-modal conflict detection
—Audio-visual temporal reasoning
—Multimodal question answering on synthetic data videos
—Robustness evaluation under counterfactual splicing

Modalities

—Video (.mp4)
—Audio (.wav)
—Structured annotations (.json, .jsonl)

Domains

—Finance
—Medical monitoring
—Industrial IoT

Repository Structure

text

AV-QuantBench-HF-Dataset/
├── README.md
├── LICENSE
├── .gitattributes
├── dataset_infos.json
├── metadata/
│   ├── train.jsonl
│   ├── val.jsonl
│   └── test.jsonl
├── qa/
│   ├── train.jsonl
│   ├── val.jsonl
│   └── test.jsonl
├── manifests/
│   ├── finance.jsonl
│   ├── medical.jsonl
│   └── iiot.jsonl
├── samples/
│   ├── finance/
│   │   ├── videos/
│   │   ├── audio/
│   │   ├── qa/
│   │   └── metadata/
│   ├── medical/
│   │   ├── videos/
│   │   ├── audio/
│   │   ├── qa/
│   │   └── metadata/
│   └── iiot/
│       ├── videos/
│       ├── audio/
│       ├── qa/
│       └── metadata/
└── docs/
    ├── schema.md
    └── responsible_use.md