Datasetpublic

EleutherAI/arithmetic

A small battery of 10 tests that involve asking language models a simple arithmetic problem in natural language.

sourceHugging Faceupdated 4y agoView on Hugging Face

5likes5kdownloads

filefive_digit_addition.jsonl153 KBdownload

filefive_digit_subtraction.jsonl154 KBdownload

filefour_digit_addition.jsonl147 KBdownload

filefour_digit_subtraction.jsonl149 KBdownload

filesingle_digit_three_ops.jsonl136 KBdownload

filethree_digit_addition.jsonl141 KBdownload

filethree_digit_subtraction.jsonl143 KBdownload

filetwo_digit_addition.jsonl135 KBdownload

filetwo_digit_multiplication.jsonl139 KBdownload

filetwo_digit_subtraction.jsonl137 KBdownload

EleutherAI/arithmetic · main · files are served by the source, never re-hosted here