datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ChartGalaxy
ChartGalaxy: A Dataset for Infographic Chart Understanding and Generation
🤗 Dataset | 🖥️ Code | 📄 Paper | 📄 Arxiv
🔥 News
[2026.09] 🎉🎉 A new high-quality batch of 14,809 synthetic infographic charts has been added.
This update features more complex layouts and richer chart variations.
[2026.02] 🎉🎉 A new batch of data has been added, comprising 108,208 infographic charts.
This update features broader diversity in title designs and more polished layouts… See the full description on the dataset page: https://huggingface.co/datasets/ChartGalaxy/ChartGalaxy.ChartQA
Dataset Card for "ChartQA"
More Information needed
ChartQA
Large-scale Multi-modality Models Evaluation Suite
Accelerating the development of large-scale multi-modality models (LMMs) with lmms-eval
🏠 Homepage | 📚 Documentation | 🤗 Huggingface Datasets
This Dataset
This is a formatted version of ChartQA. It is used in our lmms-eval pipeline to allow for one-click evaluations of large multi-modality models.
@article{masry2022chartqa,
title={ChartQA: A benchmark for question answering about charts with visual and… See the full description on the dataset page: https://huggingface.co/datasets/lmms-lab-encoder/ChartQA.ChartNet
ChartNet: A Million-Scale Multimodal Dataset for Chart Understanding
🌐 Homepage | 📖 arXiv
📝 Changelog
June 3, 2026 — Release of grounded_qa subset and completed reasoning subset (both subject to Notice Regarding Data Availability)
May 15, 2026 — Added link to 30K real-world charts and detailed captions dataset released by our collaborators Abaka AI/2077AI.
April 29, 2026 — Release of an additional 2.5 million row subset core_permissive (subject to… See the full description on the dataset page: https://huggingface.co/datasets/ibm-granite/ChartNet.ChartDiff
ChartDiff: A Large-Scale Benchmark for Comprehending Pairs of Charts
Overview
ChartDiff is a large-scale benchmark for cross-chart comparative summarization, designed to evaluate whether vision-language models can identify differences and generate coherent comparative descriptions across pairs of charts.
Unlike existing chart understanding datasets that emphasize single-chart interpretation, ChartDiff requires models to compare two charts jointly and generate a concise… See the full description on the dataset page: https://huggingface.co/datasets/ckchaos/ChartDiff.Chart2CodeFrom Charts to Code: A Hierarchical Benchmark for Multimodal Models
Welcome to Chart2Code! If you find this repo useful, please give a star ⭐ for encouragement.
Data Overview
Chart2Code is a hierarchical benchmark for evaluating multimodal models on chart understanding and chart-to-code generation. The dataset is organized into five Hugging Face configurations:
level1_direct
level1_customize
level1_figure
level2
level3
In the current… See the full description on the dataset page: https://huggingface.co/datasets/CSU-JPG/Chart2Code.bettor-chart-imagesChartM3ChartQAIf you wanna use the dataset, you need to download the zip file manually from the "Files and versions" tab.
Please note that this dataset can not be directly loaded with the load_dataset function from the datasets library.
If you want a version of the dataset that can be loaded with the load_dataset function, you can use this one: https://huggingface.co/datasets/ahmed-masry/chartqa_without_images
But it doesn't contain the chart images. Hence, you will still need to use the images stored in… See the full description on the dataset page: https://huggingface.co/datasets/ahmed-masry/ChartQA.ChartMuseum
[NeurIPS 2025] ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models
Authors: Liyan Tang, Grace Kim, Xinyu Zhao, Thom Lake, Wenxuan Ding, Fangcong Yin, Prasann Singhal, Manya Wadhwa, Zeyu Leo Liu, Zayne Sprague, Ramya Namuduri, Bodun Hu, Juan Diego Rodriguez, Puyuan Peng, Greg Durrett
Leaderboard 🥇 | Paper 📃 | Code 💻
Overview
ChartMuseum is a chart question answering benchmark designed to evaluate reasoning capabilities of large… See the full description on the dataset page: https://huggingface.co/datasets/lytang/ChartMuseum.ChartDQAChartVerse-SFT-1.8MChartVerse-SFT-1800K is an extended large-scale chart reasoning dataset with Chain-of-Thought (CoT) annotations, developed as part of the opendatalab/ChartVerse project. For more details about our method, datasets, and full model series, please visit our Project Page.
This dataset contains all verified correct samples without failure rate filtering. Unlike SFT-600K which excludes easy samples (r=0), SFT-1800K includes the complete set of truth-anchored QA pairs for maximum coverage and scale.… See the full description on the dataset page: https://huggingface.co/datasets/opendatalab/ChartVerse-SFT-1.8M.ChartQAPro
ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answering
🤗Dataset | 🖥️Code | 📄Paper
The abstract of the paper states that:
Charts are ubiquitous, as people often use them to analyze data, answer questions, and discover critical insights. However, performing complex analytical tasks with charts requires significant perceptual and cognitive effort. Chart Question Answering (CQA) systems automate this process by enabling models to interpret and reason with… See the full description on the dataset page: https://huggingface.co/datasets/ahmed-masry/ChartQAPro.chartqa_without_images
Dataset Card for "chartqa_without_images"
If you wanna load the dataset, you can run the following code:
from datasets import load_dataset
data = load_dataset('ahmed-masry/chartqa_without_images')
The dataset has the following structure:
DatasetDict({
train: Dataset({
features: ['imgname', 'query', 'label', 'type'],
num_rows: 28299
})
val: Dataset({
features: ['imgname', 'query', 'label', 'type'],
num_rows: 1920
})
test:… See the full description on the dataset page: https://huggingface.co/datasets/ahmed-masry/chartqa_without_images.VisRAG-Ret-Test-ChartQA
Dataset Description
This is a VQA dataset based on Charts from ChartQA dataset from ChartQA.
Load the dataset
from datasets import load_dataset
import csv
def load_beir_qrels(qrels_file):
qrels = {}
with open(qrels_file) as f:
tsvreader = csv.DictReader(f, delimiter="\t")
for row in tsvreader:
qid = row["query-id"]
pid = row["corpus-id"]
rel = int(row["score"])
if qid in qrels:… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/VisRAG-Ret-Test-ChartQA.ChartVerse-SFT-600KChartVerse-SFT-600K is a large-scale, high-quality chart reasoning dataset with Chain-of-Thought (CoT) annotations, developed as part of the opendatalab/ChartVerse project. For more details about our method, datasets, and full model series, please visit our Project Page.
This dataset contains non-trivial samples filtered by failure rate (r > 0), ensuring that every sample provides meaningful learning signal. Samples that are too easy (r = 0, where the model always answers correctly) are… See the full description on the dataset page: https://huggingface.co/datasets/opendatalab/ChartVerse-SFT-600K.chartqaadaption-charts-p2-gold
Adaption Charts P2 — Gold Chart-QA Dataset
A verified, quality-first chart question-answering dataset built for the
Adaption Labs AutoScientist Challenge (Part 2, Data Visualization track).
Two sources: a programmatically generated synthetic core
(correct-by-construction) and a hand-authored hardset built from real
public dashboards and reports.
At a glance
3803 rows total — 3705 synthetic + 98 hardset
7 chart types — bar, line, grouped_bar, stacked_bar, pie… See the full description on the dataset page: https://huggingface.co/datasets/vinod-anbalagan/adaption-charts-p2-gold.ChartGen-200KVLLM_ChartQAgridline-chartqa
Adaption Charts P2 — Gold Chart-QA Dataset
A verified, quality-first chart question-answering dataset built for the
Adaption Labs AutoScientist Challenge (Part 2, Data Visualization track).
Two sources: a programmatically generated synthetic core
(correct-by-construction) and a hand-authored hardset built from real
public dashboards and reports.
At a glance
1415 rows total — 1317 synthetic + 98 hardset
7 chart types — bar, line, grouped_bar, stacked_bar, pie… See the full description on the dataset page: https://huggingface.co/datasets/vinod-anbalagan/gridline-chartqa.ChartX
ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
[ Related Paper ] [ Website ] [Models 🤗(Hugging Face)]
ChartX & ChartVLM
Recently, many versatile Multi-modal Large Language Models (MLLMs) have emerged continuously. However, their capacity to query information depicted in visual charts and engage in reasoning based on the queried contents remains under-explored. In this paper, to comprehensively and rigorously benchmark the ability… See the full description on the dataset page: https://huggingface.co/datasets/InternScience/ChartX.ECD-10k-Images
Effective Training Data Synthesis for Improving MLLM Chart Understanding
The Effective Chart Dataset (ECD-10k-Images) is a high-quality, multimodal dataset designed to enhance chart understanding capabilities in Multimodal Large Language Models (MLLMs). This dataset includes over 10,000 synthetic chart images and 321,544 QA pairs (both descriptive and reasoning) spanning 29 chart types, 25 themes, and 252 unique chart combinations. By addressing data realism, complexity, and… See the full description on the dataset page: https://huggingface.co/datasets/ChartFoundation/ECD-10k-Images.ChartAnno
ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generation
The official dataset repository of ChartAnno
1,200 real-world charts · 3,600 instructions · 10,800 instances (+720 D3/SVG) · 3 representations · 17 chart types
1. Data Overview
Annotations are essential to communicative visualization, helping explain data, emphasize key findings… See the full description on the dataset page: https://huggingface.co/datasets/chartanno/ChartAnno.chartverse-allChartQAChartBenchchartwise-autoscientist-data
ChartWise AutoScientist
This is a deterministic synthetic source dataset generated for AutoScientist adaptation.
Task
Each row contains a chart image URL, a visual reasoning prompt, and an evidence-grounded completion.
The benchmark covers bar, line, grouped bar, stacked bar, and scatter plots.
Training Columns
image: chart image URL
prompt: question and answer format instruction
completion: direct answer and concise visual evidence
All other… See the full description on the dataset page: https://huggingface.co/datasets/doraking/chartwise-autoscientist-data.ChartQA_small_preprocessedChartM3