skip to content
iii / worker
$registry / workers

judge-typesafe

v0.2.5

TypeSafe evaluation (judge-typesafe::evaluate), model listing (judge-typesafe::models::list) and caller-scoped cancellation (judge-typesafe::cancel), with typed usage, provider errors, per-call retries and worker-owned credentials.

worker
iiiverified
1,890 installs484 in 7d94 today
install
$iii trigger compose::add worker=judge-typesafe
binarylicense: Apache-2.0choiceevaluationnoulrelevancescoretypesafe
  • macOS: arm64 · x64
  • Linux: arm64 · armv7 · x64
  • Windows: arm64 · x64
8functions0triggers0skills1depsv0.2.5version
repoiii-hq/workers

exact versions are immutable; binary and bundle artifacts are digest-pinned.

functions

8

judge-typesafe::cancel

function

Signal cancellation of an active evaluation or model listing owned by the calling worker. Returns whether a signal was accepted; does not roll back provider work. Requires the same worker replica as the original call.

request
  • request_idstringrequired1…128 chars
response
one of (2)
variant 1
  • cancelledbooleanrequired
  • statusstringrequiredenum: ok
variant 2
  • codeone ofrequired
    one of (2)
    variant 1
    valuestringenum: invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    variant 2
    valuestringenum: provider_unavailable
  • statusstringrequiredenum: error

judge-typesafe::configuration-id

function

Returns this worker instance's effective configuration entry ID, without its value.

request
empty object
response
  • idstringrequired

judge-typesafe::evaluate

function

Evaluate Noul, Choice and Score questions against arbitrary JSON state using JEV. Results are atomic; stats retain known accepted usage and mark unknown counters incomplete. No credentials are accepted in the request.

request
  • evaluationsobject[]required1…512 items
    • idstringrequired
    • questionsobjectrequired
    • stateany ofrequired

      Score levels require a description. Unlike instructions, Choice option descriptions and Noul criteria, the provider rejects a null level (HTTP422).

      any of (3)
      variant 1
      valuestring
      variant 2
      empty object
      variant 3
      itemsunknown[]
  • expires_at_unix_msinteger· uint64min 0
  • modelstring
  • optionsall of
    all of (1)
    variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64requiredmin 1
response
one of (2)
variant 1
  • modelstringrequired
  • resultsobjectrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum: ok
variant 2
  • codeone ofrequired
    one of (2)
    variant 1
    valuestringenum: invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    variant 2
    valuestringenum: provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum: error

judge-typesafe::models::list

function

List the provider's available model names, descriptions and release dates. Shares evaluation credentials, transport limits and permits; performs no inference.

request
  • expires_at_unix_msinteger· uint64min 0
  • optionsall of
    all of (1)
    variant 1
    • attempt_timeout_msinteger· uint64min 1

      Bounds each network attempt separately from the whole-call deadline.

  • request_idstring1…128 chars
  • timeout_msinteger· uint64min 1
response
one of (2)
variant 1
  • modelsobject[]required
    • context_windowinteger· uint32min 0

      Tokens one evaluation row can hold (question, options and state), when the provider has a fixed window. Callers size their states from it.

    • descriptionstringrequired
    • max_optionsinteger· uint32min 0

      Most options one Choice question (or levels one Score) can offer, when the provider has a fixed limit below the contract's 255. Callers size their option groups from it.

    • namestringrequired
    • release_datestringrequired
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum: ok
variant 2
  • codeone ofrequired
    one of (2)
    variant 1
    valuestringenum: invalid_request, missing_key, payload_too_large, deadline, attempt_timeout, cancelled, …
    variant 2
    valuestringenum: provider_unavailable
  • http_statusinteger· uint16min 0
  • provider_errorany of
    any of (2)
    variant 1
    • detailunknown
    • messagestring
    • truncatedboolean
    variant 2
    valuenull
  • retry_after_msinteger· uint64min 0
  • statsobjectrequired

    Known accepted usage, never a billing estimate. Unreported counters or failure/cancellation make usage_complete false.

    • attemptsinteger· uintrequiredmin 0
    • elapsed_msinteger· uint64requiredmin 0
    • input_tokensinteger· uint64requiredmin 0
    • output_tokensinteger· uint64requiredmin 0
    • questionsinteger· uintrequiredmin 0
    • requestsinteger· uintrequiredmin 0
    • usage_completebooleanrequired
  • statusstringrequiredenum: error

judge-typesafe::on-config-change

function

Internal: reload JEV configuration from authoritative storage.

request
  • idstring

    Configuration id that changed.

response
  • okbooleanrequired

judge-typesafe::on-secret-change

function

Internal: drop a cached secret:// API key after the secrets worker changed it.

request
  • namestring
  • refstring
response
  • okbooleanrequired

judge-typesafe::status

function

Whether evaluations hold a usable key (api_key, a secret:// reference or TYPESAFE_API_KEY at boot), with the fix when they do not. No network call; never returns the key.

request
empty object
response
  • configuredbooleanrequired

    An evaluation would get past credentials: a hosted provider holds a usable key. Says nothing about whether the upstream accepts it.

  • reasonstring

    Why not, naming the fix and never a value.

judge-typesafe::ui-content

function

Serve the judge-typesafe worker's injected console UI assets (content function for its console:script / console:style / console:module triggers).

request
  • pathstringrequired

    The asset path from the trigger config (e.g. `state/page.js`).

response
  • contentstringrequired

    The asset source, verbatim.

  • content_typestringrequired

    MIME type the console should serve the asset with.

triggers

0
no triggers registered