Creates a versioned golden suite.

POST

/v1/m/evals/suites

curl --request POST \
  --url https://example.com/v1/m/evals/suites \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{ "criterion": "example", "description": "example", "judge_model": "example", "name": "example", "pass_threshold": 1, "regression_threshold": 1, "scorer": "example", "subject_kind": "agent", "suite_version": 1 }'

• this engine

Creates a versioned golden suite. Write-tier + self-audited.

Authorizations

• bearerAuth

Parameters

Header Parameters

X-Olivares-Tenant

string format: uuid

Target tenant id; required when the principal can act in more than one tenant.

Request Body ^required

Media type application/json

object

criterion

string

description

string

judge_model

string

name

required

string

>= 1 characters

pass_threshold

number

regression_threshold

number

scorer

required

string

>= 1 characters

subject_kind

required

string

Allowed values: agent model prompt session sandbox_run

suite_version

integer format: int64

Responses

200

OK

Media type application/json

object

Example ^generated

{}

400

Bad request

Media type application/json

object

Example ^generated

{}

401

Unauthenticated

Media type application/json

object

Example ^generated

{}

403

Forbidden

Media type application/json

object

Example ^generated

{}

404

Not found

Media type application/json

object

Example ^generated

{}

409

Conflict / setup required

Media type application/json

object

Example ^generated

{}

429

Rate limited

Media type application/json

object

Example ^generated

{}