mlfoundations-dev/a1_science_stackexchange_physics_eval_636d

mlfoundations-dev/a1sciencestackexchangephysics1744737192eval636d

Precomputed model outputs for evaluation.

Evaluation Results

Summary

AIME24

• —Average Accuracy: 19.67% ± 0.57%
• —Number of Runs: 10

AMC23

• —Average Accuracy: 57.50% ± 1.54%
• —Number of Runs: 10

MATH500

• —Accuracy: 75.60% | Accuracy | Questions Solved | Total Questions | |----------|-----------------|----------------| | 75.60% | 378 | 500 |

MMLUPro

• —Average Accuracy: 31.00% ± 0.00%
• —Number of Runs: 1

JEEBench

• —Average Accuracy: 43.85% ± 0.48%
• —Number of Runs: 3

GPQADiamond

• —Average Accuracy: 42.59% ± 1.37%
• —Number of Runs: 3

LiveCodeBench

• —Average Accuracy: 22.70% ± 1.20%
• —Number of Runs: 3

CodeElo

• —Average Accuracy: 5.29% ± 0.23%
• —Number of Runs: 3

CodeForces

• —Average Accuracy: 7.58% ± 0.60%
• —Number of Runs: 3