skip to content
$worker

provider-llamacpp

v0.3.9

llama.cpp server (llama-server) Chat Completions provider worker; implements provider::llamacpp::stream and provider::llamacpp::refresh_models behind llm-router.

iiiverified
30 installs0 in 7d0 today
install
$iii trigger compose::add worker=provider-llamacpp@0.3.9
binarylicense: Apache-2.0llama.cppllmlocalopen-sourceprovider
  • macOS: arm64
  • Linux: arm64 · armv7 · x64
  • Windows: arm64 · x64

exact versions are immutable; binary and bundle artifacts are digest-pinned.