provider-llamacpp

Name: provider-llamacpp
Author: iii

v0.2.2

llama.cpp server (llama-server) Chat Completions provider worker; implements provider::llamacpp::stream and provider::llamacpp::refresh_models behind llm-router.

Published 2mo agollama.cpp llm local open-source provider

Install

bash

iii trigger compose::add worker=provider-llamacpp@0.2.2

Run in your project with the iii engine running. Exact versions are immutable and digest-pinned.

Dependency · 2Version

iii-state^0.21.6
llm-router^1.0.0

Install

Search the registry