cloudcatcher2/VCBench

Overview VCBench provides a standardized framework for evaluating vision-language models. This document outlines the procedures for both standard evaluation and GPT-assisted evaluation of your model's outputs. 1. Standard Evaluation 1.1 Output Format Requirements Models must produce outputs in JSONL format with the following structure: {"id": <int>, "pred_answer": "<answer_letter>"} {"id": <int>, "pred_answer": "<answer_letter>"} ... Example File… See the full description on the dataset page: https://huggingface.co/datasets/cloudcatcher2/VCBench.