Skip to content

Reports each server: installed, running or not, its endpoint and the models it serves.

GET
/v1/m/agenttools/model-servers
curl --request GET \
--url https://example.com/v1/m/agenttools/model-servers \
--header 'Authorization: Bearer <token>'

Reports each server: installed, running or not, its endpoint and the models it serves.

Each local OpenAI-compatible model server (llama.cpp, vLLM): installed, running or not, its endpoint and the models it serves

Media type application/json
object
servers
required
Array<object>
object
endpoint
string
installed
required
boolean
kind
required
string
Allowed values: llama-cpp vllm
message
string
model
string
models
required
Array<string>
name
required
string
state
required
string
Allowed values: stopped starting running failed
Example
{
"servers": [
{
"kind": "llama-cpp",
"state": "stopped"
}
]
}

Bad request

Media type application/json
object
Example generated
{}

Unauthenticated

Media type application/json
object
Example generated
{}

Forbidden / step-up required

Media type application/json
object
Example generated
{}

Not found

Media type application/json
object
Example generated
{}

Conflict

Media type application/json
object
Example generated
{}

Required evidence or store unavailable

Media type application/json
object
Example generated
{}