ClaasBeger/ConceptARC_Rule_Annotations

ConceptARC Rule Annotations Model outputs, natural-language rules and human judgements of those rules on the 480 tasks of the ConceptARC benchmark. This is the data behind the paper Distinguishing Performance From Competence in Evaluations of Humanlike Abstract Reasoning (NeurIPS 2026, Evaluations and Datasets Track). Paper: arXiv:2510.02125 Project page and interactive viewer: claasbeger.github.io/performance-competence-gap Authors: Claas Beger, Ryan Yi, Shuhao Fu, Kaleda… See the full description on the dataset page: https://huggingface.co/datasets/ClaasBeger/ConceptARC_Rule_Annotations.