arithmetics
arithmetic_subtractionarithmeticsarithmetic-sorl-data
Arithmetic SoRL Data
Training and evaluation data for the SoRL Arithmetic Interpretability Study.
Small transformers trained on integer addition/subtraction, with
SoRL to externalize carry/borrow circuits
as explicit abstraction tokens.
Reference: Quirke et al., "Understanding Addition and Subtraction in Transformers" (2024).
Paper: arXiv:2402.02619 — see Table 8 for complexity classification and Section 3 for sub-task definitions.
Dataset Structure
Subfolder… See the full description on the dataset page: https://huggingface.co/datasets/thoughtworks/arithmetic-sorl-data.arithmetic_subtractionarithmetics_mibarithmetics_gemma-2b