One front door + provider protocol in front of every LLM provider.
iiiverifiedexact versions are immutable; binary and bundle artifacts are digest-pinned.
Serve the llm-router worker's injected console UI assets (content function for its console:script / console:style triggers).
The asset path from the trigger config (e.g. `state/page.js`).
The asset source, verbatim.
MIME type the console should serve the asset with.
Abort an in-flight router::chat/complete by request_id; reports whether a live request was cancelled.
Stream a chat completion: route {model, provider?} to a provider, relay assistant frames to writer_ref, and return the terminal response.
Stable conversation identity, forwarded separately from the per-turn request id.
The caller's write channel (direction "write"); frames are relayed here.
Provider/transport diagnostics for logs and expandable UI details. `message` remains the stable, user-facing explanation.
Non-streaming convenience over router::chat: run the turn on an internal channel and return the final assistant message + usage.
Stable conversation identity, forwarded separately from the per-turn request id.
Optional link to the stored original in the session-manager attachment store. Transcript bookkeeping for lazy readers only: the harness clears it before `router::chat`, and no provider mapping reads it. Tolerated here so a block that still carries it deserializes instead of failing the request; omitted on the wire when absent.
Count prompt tokens for {model, provider?, system_prompt?, tools?, messages} through the resolved provider's provider::<id>::count_tokens surface; never runs the model and costs nothing.
Wire agent messages, the same shape `router::chat` accepts. Must be non-empty.
Optional link to the stored original in the session-manager attachment store. Transcript bookkeeping for lazy readers only: the harness clears it before `router::chat`, and no provider mapping reads it. Tolerated here so a block that still carries it deserializes instead of failing the request; omitted on the wire when absent.
Optional link to the stored original in the session-manager attachment store. Transcript bookkeeping for lazy readers only: the harness clears it before `router::chat`, and no provider mapping reads it. Tolerated here so a block that still carries it deserializes instead of failing the request; omitted on the wire when absent.
Optional link to the stored original in the session-manager attachment store. Transcript bookkeeping for lazy readers only: the harness clears it before `router::chat`, and no provider mapping reads it. Tolerated here so a block that still carries it deserializes instead of failing the request; omitted on the wire when absent.
Optional link to the stored original in the session-manager attachment store. Transcript bookkeeping for lazy readers only: the harness clears it before `router::chat`, and no provider mapping reads it. Tolerated here so a block that still carries it deserializes instead of failing the request; omitted on the wire when absent.
Single-variant role tags: exact-match on deserialize, correct wire string on serialize, and they let `AgentMessage` be an untagged union.
Model id the prompt targets; routes exactly like `router::chat` and selects the provider's tokenizer. Optional only when `provider` pins the destination.
Pin an explicit provider, bypassing heuristics (optional).
System prompt counted as part of the request (optional).
Function invocation schemas the turn would carry; their serialized schemas count toward the total (optional).
`provider` when a provider metering API produced the count, `tiktoken` when a local tokenizer estimated it.
Prompt tokens the provider counted for the assembled request.
Batch text embeddings through a provider's provider::<id>::embed surface. Names a provider or discovers the first embed-capable one from the live registry; one vector per input, order preserved.
Texts to embed, one vector returned per input, order preserved.
Embedding model id; the provider's default when omitted.
Provider id (e.g. `openai`); the first embed-capable provider in the live registry when omitted.
One embedding per input, in input order.
Resolve the effective model output budget using the same precedence as router::chat.
Model id to budget.
Optional caller-requested output budget. When absent, the same provider and router defaults used by `router::chat` apply.
Provider id that owns the model. Empty resolves an unambiguous model id.
The capability record (README § Model descriptor).
Set on speech models only; see [`SpeechModel`].
BCP-47 tags of the languages the model handles; empty when the provider does not say.
What a speech model does. Chat models carry no `speech` block.
Realtime input (stt) or streamed audio output (tts) is available.
Read one catalog model by {provider, id}; null when the model is not registered.
Model id to look up.
Provider id that owns the model.
The capability record (README § Model descriptor).
Set on speech models only; see [`SpeechModel`].
BCP-47 tags of the languages the model handles; empty when the provider does not say.
What a speech model does. Chat models carry no `speech` block.
Realtime input (stt) or streamed audio output (tts) is available.
List catalog models, optionally filtered by provider, a capability flag, and modality (chat by default; stt, tts, or any).
Keep only models that support this capability flag (optional).
Model family: `chat` (default), `stt`, `tts`, or `any`.
Filter to a single provider id (optional).
Set on speech models only; see [`SpeechModel`].
BCP-47 tags of the languages the model handles; empty when the provider does not say.
What a speech model does. Chat models carry no `speech` block.
Realtime input (stt) or streamed audio output (tts) is available.
Replace a provider's catalog slice — the only catalog write path (token-gated).
The full replacement set of models for this provider.
Set on speech models only; see [`SpeechModel`].
BCP-47 tags of the languages the model handles; empty when the provider does not say.
What a speech model does. Chat models carry no `speech` block.
Realtime input (stt) or streamed audio output (tts) is available.
Provider whose catalog slice is being replaced.
Registration token gating the write (optional).
Check whether a model supports a capability flag (fails open for unknown models).
Capability flag to check (e.g. `structured_output`, `vision`).
Model id to check.
Provider id that owns the model.
Internal: reactively reload the in-memory configuration snapshot and fan out provider model discovery after configuration changes.
Configuration id that changed (advisory).
Internal: a worker's function registrations changed — re-discover live providers and nudge them to re-declare, so a provider that reconnected is resolvable again without waiting for its own catalog timer.
Engine event tag (advisory).
Worker whose registered functions changed (advisory).
List registered providers with their configured/available status.
Environment variable declared by API-key providers. `None` means the provider owns authentication (OAuth, local app login, device flow).
The provider's mark as inline SVG, copied from its declaration. Absent when the provider declared none.
Provider self-declaration at attach time (token-gated upsert); composes the configuration entry schema and reconciles static models.
The provider's mark: one self-contained `<svg>` document, monochrome, drawn with a square `viewBox` and no fixed size. Consoles paint it as a `currentColor` mask next to the provider's models, so colour and scripts are ignored. Keep it under [`PROVIDER_ICON_SVG_MAX_BYTES`]; the router drops anything larger or not starting with `<svg`.
Set on speech models only; see [`SpeechModel`].
BCP-47 tags of the languages the model handles; empty when the provider does not say.
What a speech model does. Chat models carry no `speech` block.
Realtime input (stt) or streamed audio output (tts) is available.
Registration token proving ownership on re-register (omit on first declare).
Resolve a provider's effective credential + api_url + max_tokens (token-gated).
Provider id to resolve credentials/config for.
Registration token gating the resolve (optional).
OAuth write-back: store a provider credential in the configuration entry under the entry write lock (token-gated).
The credential object to store (provider-specific shape).
Provider id whose credential slice is being written.
Registration token gating the write (optional).
Read-only routing preview: resolve {model, provider?} to the chosen provider + ordered candidates without streaming.
Model id to route.
Pin an explicit provider, bypassing heuristics (optional).
Text to speech through provider::<id>::speak: {model?, provider?, text, voice?, format?} to {provider, model, audio_base64, mime}. Resolves the provider from the catalog's tts models when none is named.
Audio container wanted: `mp3` (default), `wav`, `pcm16`, `opus`. Providers answer with what they can and say so in `mime`.
BCP-47 language hint for multilingual voices.
Text-to-speech model id (a `tts` model from `router::models::list`); the provider's default when omitted.
Provider id; resolved from the model's catalog owner when omitted.
Speaking-rate multiplier; 1.0 is the voice's own pace.
Text to speak.
Voice id or name as the provider knows it; the provider's default when omitted.
The audio, base64.
MIME type of the audio, e.g. `audio/mpeg`.
Voice the provider used.
Speech to text through provider::<id>::transcribe: {model?, provider?, audio_base64, mime?, language?} to {provider, model, text, segments?}. Resolves the provider from the catalog's stt models when none is named.
The audio, base64. WAV unless `mime` says otherwise.
BCP-47 language hint; the model detects the language when omitted.
MIME type of the audio: `audio/wav` (default), `audio/mpeg`, `audio/webm`, `audio/ogg`, `audio/flac`.
Speech-to-text model id (an `stt` model from `router::models::list`); the provider's default when omitted.
Vocabulary or context hint for the recognizer, when the provider takes one.
Provider id; resolved from the model's catalog owner when omitted.
Language the provider detected or was told (BCP-47).
Timed spans when the provider produces them.
The whole transcript.
A provider reconciled its catalog slice. Payload: { provider, count }.
The provider registry changed (declare / availability flip). Payload: { provider, op }.
The router finished booting; providers bind here and re-declare after a restart.
