KBaba7/llama.cpp

1# Install pre-built version of llama.cpp2 3## Homebrew4 5On Mac and Linux, the homebrew package manager can be used via6 7```sh8brew install llama.cpp9```10The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggerganov/llama.cpp/discussions/766811 12## Nix13 14On Mac and Linux, the Nix package manager can be used via15 16```sh17nix profile install nixpkgs#llama-cpp18```19For flake enabled installs.20 21Or22 23```sh24nix-env --file '<nixpkgs>' --install --attr llama-cpp25```26 27For non-flake enabled installs.28 29This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).30 31## Flox32 33On Mac and Linux, Flox can be used to install llama.cpp within a Flox environment via34 35```sh36flox install llama-cpp37```38 39Flox follows the nixpkgs build of llama.cpp.40