datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
aime_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.
problem_type… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025.aime_2026
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (int64): Gold final answer.
problem (string): Problem statement, usually stored as LaTeX source.
Source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2026.math
Dataset Card for "livebench/math"
LiveBench is a benchmark for LLMs designed with test set contamination and objective evaluation in mind. It has the following properties:
LiveBench is designed to limit potential contamination by releasing new questions monthly, as well as having questions based on recently-released datasets, arXiv papers, news articles, and IMDb movie synopses.
Each question has verifiable, objective ground-truth answers, allowing hard questions to be scored… See the full description on the dataset page: https://huggingface.co/datasets/livebench/math.synthetic-math-toolcall-deception
Synthetic Math Tool-Call Deception
200 paired multi-turn math-assistant trajectories (400 rows) for evaluating deception
detectors on mid-trajectory tool-call misreporting.
Each trajectory: a system prompt instructs the model to compute via an execute_python
tool under a stated tool-call limit, and requires every call to carry a running
call_index argument (1 for the first call, 2 for the second, …). The platform enforcing
the limit is said to only see the reported call_index… See the full description on the dataset page: https://huggingface.co/datasets/annahbanannah/synthetic-math-toolcall-deception.math-contests-2026
Math Contests 2026 (🔗 notadib/math-contests-2026)
197 problems from national olympiads and team-selection tests held January 2026 and onward — a held-out benchmark for math reasoning, sourced after the contests ran but before solutions were widely propagated, so they should not appear in any current LLM training data.
Excluded: any contest held in 2025 — BMO Round 1 (Nov 2025), USA TSTST, USA TST (Dec 2025) and Bundeswettbewerb Mathematik (Dec 2025) — kept strictly to events… See the full description on the dataset page: https://huggingface.co/datasets/notadib/math-contests-2026.aime_2024_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME I 2024 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2024_I.aime_2024_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME II 2024 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2024_II.miklos_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from Miklos Schweitzer 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (list): Rubric… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/miklos_2025.putnam_2025
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from Putnam 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (list): Rubric or grading… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/putnam_2025.arxivmath
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath.usamo_2026
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from USAMO 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (string): Rubric or… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/usamo_2026.TemplateGSM
TemplateMath: Template-based Data Generation (TDG)
This is the official repository for the paper "Training and Evaluating Language Models with Template-based Data Generation", published at the ICLR 2025 DATA-FM Workshop.
Our work introduces Template-based Data Generation (TDG), a scalable paradigm to address the critical data bottleneck in training LLMs for complex reasoning tasks. We use TDG to create TemplateGSM, a massive dataset designed to unlock the next level of… See the full description on the dataset page: https://huggingface.co/datasets/math-ai/TemplateGSM.arxivmath-0126
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-0126.arxivmath-1225
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath December 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-1225.arxivmath-0226
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from ArXivMath used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (string): Gold final answer.
problem_type (list[string]): Problem type/category labels.
source (float64): arXiv… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/arxivmath-0226.full-math-private-n256-Qwen2.5-3B-Instruct-bonMathReal
Dataset Card for MathReal
Dataset Description
Paper Information
Dataset Examples
Leaderboard
Citation
Dataset Description
The MathReal dataset is designed to evaluate the performance of Multi-modal Large Language Models (MLLMs)on real-world K-12 mathematical questions. It consists of 2,000 high-quality math problems, each represented as an image captured in authentic educational contexts. The dataset includes various types of questions, such as multiple-choice… See the full description on the dataset page: https://huggingface.co/datasets/junfeng0288/MathReal.aime_2025_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME I 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025_I.aime_2025_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME II 2025 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2025_II.open-thoughts-4-30k-math-qwen3-32b-annotated-32768-tokens-n8-reformatted-selfconsistency
Dataset Card for Open-Thoughts-4-30K-Math-Qwen3-32B-Annotated-32768-Tokens-N8-Reformatted-SelfConsistency
Overview
This dataset is a self-consistency filtered version of marin-community/open-thoughts-4-30k-math-qwen3-32b-annotated-32768-tokens-n8-reformatted. For each prompt, 8 responses were generated by Qwen3-32B with different random seeds. A majority vote was taken over the final answers (extracted from \boxed{...}) to determine the most popular answer, and only… See the full description on the dataset page: https://huggingface.co/datasets/marin-community/open-thoughts-4-30k-math-qwen3-32b-annotated-32768-tokens-n8-reformatted-selfconsistency.brokenarxiv-0226
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv February 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv-0226.brokenarxiv-0326
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv March 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv-0326.aime_2026_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
answer (int64): Gold final answer.
problem (string): Problem statement, usually stored as LaTeX source.
Source… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2026_I.full-math-private-n256-Llama-3.2-3B-Instruct-bonbrokenarxiv
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from BrokenArXiv 2026 used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
points (int64): Maximum score for a non-final-answer or proof-style problem.
grading_scheme (string): Rubric or… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/brokenarxiv.math-code-general-prunedpreprocessed-full-math-private-n256-Llama-3.2-3B-Instruct-bonpretrain-nemotron-math-mixNormalized documents plus aligned Dolma-2 tokens and target masks.
Size
Tokens
22,927,812,461 (22.9B)
Trainable tokens
22,927,812,461 (22.9B)
Documents
21,377,358
Shards
180
UTF-8 bytes
77,994,866,327
Tokenizer
allenai/dolma2-tokenizer@5292e5d6c0f4
documents.parquet - document_id, text, part_ends, part_trainable,
must_not_split. The readable payload and the mask intent.
metadata.parquet - one text-free row per document: token span, source,
stratum… See the full description on the dataset page: https://huggingface.co/datasets/placeholderlabs/pretrain-nemotron-math-mix.aime_2023_I
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2023 I used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2023_I.aime_2023_II
Homepage and repository
Homepage: https://matharena.ai/
Repository: https://github.com/eth-sri/matharena
Dataset Summary
This dataset contains the questions from AIME 2023 II used for the MathArena Leaderboard
Data Fields
The dataset contains the following fields:
problem_idx (int64): Problem index within the corresponding MathArena benchmark.
problem (string): Problem statement, usually stored as LaTeX source.
answer (int64): Gold final answer.… See the full description on the dataset page: https://huggingface.co/datasets/MathArena/aime_2023_II.