Felipe97/llama-cpp-compiled
01.2k
1# llama-eval2 3Simple evaluation tool for llama.cpp with support for multiple datasets.4 5For a full description, usage examples, and sample results, see:6 7- [PR 21152](https://github.com/ggml-org/llama.cpp/pull/21152)8 9## Quick start10 11```bash12# Single server13python3 llama-eval.py \14 --server http://localhost:8033 \15 --model my-model \16 --dataset gsm8k --n_cases 100 \17 --grader-type regex --threads 3218 19# Multiple servers (comma-separated URLs and thread counts)20python3 llama-eval.py \21 --server http://server1:8033,http://server2:8033 \22 --server-name server1,server2 \23 --threads 16,16 \24 --dataset aime2025 --n_cases 240 \25 --grader-type regex26```27 