Skip to content
Registry

provider-llamacpp

v0.3.1

llama.cpp server (llama-server) Chat Completions provider worker; implements provider::llamacpp::stream and provider::llamacpp::refresh_models behind llm-router.

license: Apache-2.0llama.cppllmlocalopen-sourceprovider

Install

bash
iii trigger compose::add worker=provider-llamacpp@0.3.1

Run in your project with the iii engine running. Exact versions are immutable and digest-pinned.

current tags2
latestv0.3.170nextv0.3.170
all versions22
v0.3.1715h ago0v0.3.162d ago5v0.3.158d ago4v0.3.1227d ago16v0.3.111mo ago0v0.3.101mo ago0v0.3.91mo ago0v0.3.81mo ago27v0.3.71mo ago0v0.3.61mo ago0v0.3.51mo ago0v0.3.41mo ago2v0.3.21mo ago4v0.3.11mo ago3v0.3.02mo ago22v0.2.42mo ago0v0.2.32mo ago0v0.2.22mo ago0v0.2.12mo ago0v0.2.02mo ago0v0.1.23mo ago0v0.1.13mo ago0

Search the registry

Find workers, kits and executables, or jump to a page.