admin
8e5a449007
Some checks are pending
Copilot Setup Steps / copilot-setup-steps (push) Waiting to run
Check Pre-Tokenizer Hashes / pre-tokenizer-hashes (push) Waiting to run
Python check requirements.txt / check-requirements (push) Waiting to run
Python Type-Check / python type-check (push) Waiting to run
Update Operations Documentation / update-ops-docs (push) Waiting to run
1.1 KiB
1.1 KiB
Install pre-built version of llama.cpp
| Install via | Windows | Mac | Linux |
|---|---|---|---|
| Winget | ✅ | ||
| Homebrew | ✅ | ✅ | |
| MacPorts | ✅ | ||
| Nix | ✅ | ✅ |
Winget (Windows)
winget install llama.cpp
The package is automatically updated with new llama.cpp releases. More info: https://github.com/ggml-org/llama.cpp/issues/8188
Homebrew (Mac and Linux)
brew install llama.cpp
The formula is automatically updated with new llama.cpp releases. More info: https://github.com/ggml-org/llama.cpp/discussions/7668
MacPorts (Mac)
sudo port install llama.cpp
See also: https://ports.macports.org/port/llama.cpp/details/
Nix (Mac and Linux)
nix profile install nixpkgs#llama-cpp
For flake enabled installs.
Or
nix-env --file '<nixpkgs>' --install --attr llama-cpp
For non-flake enabled installs.
This expression is automatically updated within the nixpkgs repo.