Skip to content

Measures the wired judge against a labeled set.

POST
/v1/m/evals/calibration/run
curl --request POST \
--url https://example.com/v1/m/evals/calibration/run \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '{ "judge_model": "example", "kappa_floor": 1, "set_name": "example", "target": 1 }'

Measures the wired judge against a labeled set. The judge calls run OUTSIDE any transaction (two-phase); the report + core EvalResult (+ a Finding when below target) persist atomically.

X-Olivares-Tenant
string format: uuid

Target tenant id; required when the principal can act in more than one tenant.

Media type application/json
object
judge_model
string
kappa_floor
number
set_name
string
target
number
Example generated
{
"judge_model": "example",
"kappa_floor": 1,
"set_name": "example",
"target": 1
}

OK

Media type application/json
object
Example generated
{}

Bad request

Media type application/json
object
Example generated
{}

Unauthenticated

Media type application/json
object
Example generated
{}

Forbidden

Media type application/json
object
Example generated
{}

Not found

Media type application/json
object
Example generated
{}

Conflict / setup required

Media type application/json
object
Example generated
{}

Rate limited

Media type application/json
object
Example generated
{}