Skip to main content
The CI eval gate turns an eval run into a pass/warn/block decision suitable for a CI check. Run your eval (POST /v1/eval), then call POST /v1/ci/gate with the run ID and a policy, and gate the build on the returned decision.

Endpoint — POST /v1/ci/gate

Request

  • score_floor — absolute floor. If mean_score < score_floor, the gate fires.
  • delta_tolerance — negative number. If mean_score - baseline_mean_score < delta_tolerance, the gate fires. Requires baseline_run_id.
  • on_failwarn or block. Controls the decision value emitted on failure (pass is always returned when the run is within policy).

Response

The reason string is safe to surface directly in CI output.

GitHub Actions example

Dashboard

A lightweight UI for manual gate checks lives at Dashboard → Settings → CI Gate. It hits the same endpoint — useful for trying out a policy before wiring it into CI.

See also