neurallambda/arithmetic_dataset

Arithmetic Puzzles Dataset A collection of arithmetic puzzles with heavy use of variable assignment. Current LLMs struggle with variable indirection/multi-hop reasoning, this should be a tough test for them. Inputs are a list of strings representing variable assignments (c=a+b), and the output is the integer answer. Outputs are filtered to be between [-100, 100], and self-reference/looped dependencies are forbidden. Splits are named like: train_N 8k total examples of puzzles… See the full description on the dataset page: https://huggingface.co/datasets/neurallambda/arithmetic_dataset.