vanyacohen/MET-Bench-Shell

MET-Bench: Multimodal Entity Tracking for Evaluating the Limitations of Vision-Language and Reasoning Models Vanya Cohen and Raymond Mooney · ICML 2026 Paper · Project page · Load the dataset · Citation Domains: Chess · Shell Game · Minecraft MET-Bench evaluates entity state tracking across text and image modalities. This repository contains the Shell Game domain. Shell Game A ball is placed under one of three shells. The shells are swapped pairwise, and the goal… See the full description on the dataset page: https://huggingface.co/datasets/vanyacohen/MET-Bench-Shell.