Skip to content

models module route (requires models:registry:write)

POST
/v1/m/models/inference-deployments
curl --request POST \
--url https://example.com/v1/m/models/inference-deployments \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '"example"'

Creates one inference deployment; its model and version references must resolve, and the admission policy can refuse it.

X-Olivares-Tenant
string format: uuid

Target tenant id; required when the principal can act in more than one tenant.

Media type application/json
object
deployment_type

When omitted, both owned_ref and version_ref derive local; otherwise the handler derives unclassified.

string
Allowed values: "" local brokered unclassified
endpoint_ref
string
governed
boolean
id
string
name
required
string
>= 1 characters /\S/
note
string
owned_ref
string
runtime
required
string
Allowed values: vllm ollama llamacpp other
status
string
default: active
Allowed values: "" active stopped
version_ref
string

OK

Media type application/json
object
Example generated
{}

Bad request

Media type application/json
object
Example generated
{}

Unauthenticated

Media type application/json
object
Example generated
{}

Forbidden

Media type application/json
object
Example generated
{}

Not found

Media type application/json
object
Example generated
{}

Conflict / setup required

Media type application/json
object
Example generated
{}

Rate limited

Media type application/json
object
Example generated
{}