provider::deepseek::abort
Cancel the in-flight upstream stream for a request_id (router::abort fan-out), stopping billed generation immediately.
- request_idstringrequired
- abortedbooleanrequired
DeepSeek Chat Completions provider worker; implements provider::deepseek::stream and provider::deepseek::refresh_models behind llm-router.
exact versions are immutable; binary and bundle artifacts are digest-pinned.
Cancel the in-flight upstream stream for a request_id (router::abort fan-out), stopping billed generation immediately.
Count prompt tokens for {model, system_prompt?, tools?, messages} locally with DeepSeek's own published vocabulary; never runs the model and costs nothing.
Wire agent messages, the same shape `provider::deepseek::stream` accepts. Must be non-empty.
Single-variant role tags: exact-match on deserialize, correct wire string on serialize, and they let `AgentMessage` be an untagged union.
Model id the prompt targets. Reported back unchanged; every DeepSeek chat model shares the one vocabulary.
System prompt counted as its own wire message when present.
Function invocation schemas; each serialized schema counts toward the total.
Always `tokenizer`: the model's own vocabulary produced the count.
Prompt tokens for the assembled request, by DeepSeek's vocabulary.
Internal: router::ready subscriber that re-declares this provider and refreshes its catalog.
Reconcile the DeepSeek catalog slice through the router: list the upstream models, enrich each with local metadata, and return the model count written.
Stream a DeepSeek chat completion: resolve credentials, call the upstream Chat Completions API, and relay AssistantMessageEvent frames to writer_ref.
Single-variant role tags: exact-match on deserialize, correct wire string on serialize, and they let `AgentMessage` be an untagged union.
Stable conversation identity for provider cache affinity.