Skip to content

Evaluates the gate.

POST
/v1/m/evals/gate
curl --request POST \
--url https://example.com/v1/m/evals/gate \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '{ "baseline_ref": "example", "comparison": { "mode": "same_candidate", "version": 1 }, "model_ref": "example", "outputs": { "additionalProperty": "example" }, "prompt_variant": "example", "sample_size": 1, "seed": "example", "subject_kind": "example", "subject_ref": "example", "suite_ref": "example" }'

Evaluates the gate. Three-phase like every judged path: read (suite, cases, calibration, cache), score outside any transaction, persist atomically.

X-Olivares-Tenant
string format: uuid

Target tenant id; required when the principal can act in more than one tenant.

Media type application/json
object
baseline_ref
string
comparison
object
mode
required

Candidate_change requires an explicit baseline_ref and declared candidate identities.

string
Allowed values: same_candidate candidate_change
version
required
integer
Allowed values: 1
model_ref
string
outputs
required
object
key
additional properties
string
prompt_variant
string
sample_size
integer
seed
string
subject_kind
string
subject_ref
string
suite_ref
required
string
>= 1 characters

OK

Media type application/json
object
Example generated
{}

Bad request

Media type application/json
object
Example generated
{}

Unauthenticated

Media type application/json
object
Example generated
{}

Forbidden

Media type application/json
object
Example generated
{}

Not found

Media type application/json
object
Example generated
{}

Conflict / setup required

Media type application/json
object
Example generated
{}

Rate limited

Media type application/json
object
Example generated
{}