Team Ai
Modelpublic

Felipe97/llama-cpp-compiled

sourceHugging Faceupdated 21d agoView on Hugging Face
0likes1.2kdownloads
README.md27 linesDownload Raw Back to llama-eval
1# llama-eval2 3Simple evaluation tool for llama.cpp with support for multiple datasets.4 5For a full description, usage examples, and sample results, see:6 7- [PR 21152](https://github.com/ggml-org/llama.cpp/pull/21152)8 9## Quick start10 11```bash12# Single server13python3 llama-eval.py \14  --server http://localhost:8033 \15  --model my-model \16  --dataset gsm8k --n_cases 100 \17  --grader-type regex --threads 3218 19# Multiple servers (comma-separated URLs and thread counts)20python3 llama-eval.py \21  --server http://server1:8033,http://server2:8033 \22  --server-name server1,server2 \23  --threads 16,16 \24  --dataset aime2025 --n_cases 240 \25  --grader-type regex26```27