Creates or RE-labels reference items (upsert by set+case_key: a correction is an audited update, the history lives in the ledger).

POST

/v1/m/evals/calibration/items

curl --request POST \
  --url https://example.com/v1/m/evals/calibration/items \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{ "items": [ { "case_key": "example", "criterion": "example", "expected": "example", "human_passed": true, "human_score": 1, "input": "example", "notes": "example", "output": "example" } ], "set_name": "example" }'

• this engine

Creates or RE-labels reference items (upsert by set+case_key: a correction is an audited update, the history lives in the ledger).

Authorizations

• bearerAuth

Parameters

Header Parameters

X-Olivares-Tenant

string format: uuid

Target tenant id; required when the principal can act in more than one tenant.

Request Body ^required

Media type application/json

object

items

required

Array<object>

>= 1 items

object

case_key

required

string

>= 1 characters

criterion

string

expected

string

human_passed

boolean

human_score

Any of:

number

number

<= 1

null

null

input

string

notes

string

output

required

string

>= 1 characters

set_name

string

Example ^generated

{
  "items": [
    {
      "case_key": "example",
      "criterion": "example",
      "expected": "example",
      "human_passed": true,
      "human_score": 1,
      "input": "example",
      "notes": "example",
      "output": "example"
    }
  ],
  "set_name": "example"
}

Responses

200

OK

Media type application/json

object

Example ^generated

{}

400

Bad request

Media type application/json

object

Example ^generated

{}

401

Unauthenticated

Media type application/json

object

Example ^generated

{}

403

Forbidden

Media type application/json

object

Example ^generated

{}

404

Not found

Media type application/json

object

Example ^generated

{}

409

Conflict / setup required

Media type application/json

object

Example ^generated

{}

429

Rate limited

Media type application/json

object

Example ^generated

{}