Team Ai
Datasetpublic

echodict/llama.cpp

version https://git-lfs.github.com/spec/v1 oid sha256:cfc44b7ba25614df70e6b65e3341cae0310163bd32fd31a6b928a542df433faf size 30786

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes479downloads
install.md51 linesDownload Raw Back to docs
1# Install pre-built version of llama.cpp2 3| Install via | Windows | Mac | Linux |4|-------------|---------|-----|-------|5| Winget      | ✅      |      |      |6| Homebrew    |         | ✅   | ✅   |7| MacPorts    |         | ✅   |      |8| Nix         |         | ✅   | ✅   |9 10## Winget (Windows)11 12```sh13winget install llama.cpp14```15 16The package is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/issues/818817 18## Homebrew (Mac and Linux)19 20```sh21brew install llama.cpp22```23 24The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/discussions/766825 26## MacPorts (Mac)27 28```sh29sudo port install llama.cpp30```31 32See also: https://ports.macports.org/port/llama.cpp/details/33 34## Nix (Mac and Linux)35 36```sh37nix profile install nixpkgs#llama-cpp38```39 40For flake enabled installs.41 42Or43 44```sh45nix-env --file '<nixpkgs>' --install --attr llama-cpp46```47 48For non-flake enabled installs.49 50This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).51