gsarch/mmstar_500_lite
mmstar: 500-sample lite benchmark 500 evaluation examples sampled with seed 42. Sampling: uniform random rows without replacement. Sources and attribution morpheushoc/MMStar_opencompass, revision 6cc296736fa01334391ec0b819b04d9836e34a3a. Original dataset and source-image terms apply; this subset does not relicense them. See the linked upstream datasets for their license and citation information. Reproducibility subset.json records the pinned… See the full description on the dataset page: https://huggingface.co/datasets/gsarch/mmstar_500_lite.
mmstar: 500-sample lite benchmark
500 evaluation examples sampled with seed 42. Sampling: uniform random rows without replacement.
Sources and attribution
- morpheushoc/MMStar_opencompass, revision
6cc296736fa01334391ec0b819b04d9836e34a3a.
Original dataset and source-image terms apply; this subset does not relicense them. See the linked upstream datasets for their license and citation information.
Reproducibility
subset.json records the pinned sources, selected source indices, decoded-image/label hashes, native task configurations, seed, and sampling procedure. _lite_source_index and _lite_task_id identify each example in its prepared source split. Image bytes are embedded in the Parquet files; no cluster paths are required. Original pixels, questions, reference labels, and scoring fields are preserved.
This is an evaluation subset. Its scores are not full-benchmark scores. Use the native benchmark metrics from foveated_vlm. This benchmark uses automatic scoring.