← All features

Extend the toolkitAvailable in v0.3.0

TypeSafe Jev, the optional judge

TypeSafe Jev is the recommended, optional judge. It re-orders chosen skills and, in v0.3.0, judges difficulty from the Intent and Scope paths. Its tier guides model choice, subject to confidence thresholds and minimum tiers. Without a key, with Jev off or with an uncertain answer, the rules decide.

When you need it

Fixed rules score a task from its Scope alone, so their skill order and model choice can miss what a task really needs. A judge can help, but it must never become a hidden requirement or bypass the rules.

How it works

  1. oah init asks once whether to enable it, and you can enable it later in .oah/config.toml. It runs only when you enabled it and the key is present; a key alone never turns it on.
  2. Ranking: Jev re-orders the closed skill list produced by the rules. It never adds or drops a candidate.
  3. Model choice: Jev can pick a model and effort only from candidates the rules allow, subject to model pins, qualified pools, supported effort and the task's minimum requirements.
  4. Every packet plan, brief, run record and impact result says rerank=used or rerank=unused(<reason>), such as not-enabled, no key or disabled-by-brief.
  5. In v0.3.0, Jev also judges difficulty from the accepted Intent and Scope paths; its tier must meet the confidence threshold and never go below the floor.

Example

What `oah init` records when you enable the re-ranker (from Keys).

[rerank]
enabled = true
provider = "typesafe"

Requirements

  • Your own TypeSafe account and TYPESAFE_API_KEY, stored in an environment variable or the OS keychain.
  • oah doctor does not check Jev's state; the rerank= results show it.

Limits and recovery

  • TypeSafe may charge for each request.
  • Jev cannot invent a candidate or bypass a floor.
  • Impact-result re-ranking remains planned, not a shipped feature.
  • Difficulty judgement is subject to confidence thresholds and the task's minimum tier.
  • --no-rerank, or a packet that turns it off, gives rerank=unused(disabled-by-brief).

Original documents

Related