Team Ai
Modelpublic

Felipe97/llama-cpp-compiled

sourceHugging Faceupdated 21d agoView on Hugging Face
0likes1.2kdownloads
README.md27 linesDownload Raw Back to fusion
1# Fusion baselines2 3Per-device baselines for `test-fusion`, one CSV per backend (e.g. `MTL.csv`). Rows are4`arch,moe,mode,label,count`. Regenerate a CSV whenever fusion patterns change.5 6## Update a baseline7 8```sh9cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON   # enable the target backend10cmake --build build --config Release --target test-llama-archs --target test-fusion -j11 12rm -rf build-ci-models && mkdir -p build-ci-models13./build/bin/test-llama-archs -o build-ci-models14 15./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv16```17 18## Validate19 20```sh21./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv22```23 24Non-zero exit means a row differs from the baseline. Use `--model FILE` to run a single25architecture. Note `--check` only sees present rows — a fusion that stops matching is not26reported, so diff the recorded CSV to catch removed patterns.27