← All features

Verify and reviewAvailable in v0.3.0

Reviews never run below their risk floor

New in v0.3.0: a review never runs below the floor for its risk, whatever a flag, packet, profile or judge says. The floor is medium, or high when a path in the review's scope is risky or its kind needs it. It is scored again from the scope, and a refusal spends no review round or attempt.

When you need it

If a cheap profile, a flag or a judge could lower the reviewer, the one stage that guards everything else could quietly get weaker.

How it works

  1. The floor is recomputed from the review's scope, so no flag, packet axis, profile or judge answer can lower it.
  2. It is a mark on the fixed score scale, so a narrow allowed_models cannot lower it either.
  3. A review whose tier, model or effort is below the floor stops with OAH_MODEL_BELOW_FLOOR, spending no round or attempt.
  4. A review receipt records the family, floor, profile, source of the model and the scores used.

Requirements

  • Requires v0.3.0 or later.

Limits and recovery

  • A model you named that has no score runs with OAH_MODEL_FLOOR_UNCHECKED, and the receipt says the floor was not checked.
  • When no allowed model reaches the floor, the review stops and the message names allowed_models; use the tier it names, or change the pin, pool, quality_order or allowed_models.
  • For example, --tier low on a review is refused; use the tier the message names.

Original documents

Related