Skip to main content

Crate cortiq_server

Crate cortiq_server 

Source
Expand description

Cortiq Server — OpenAI-compatible API + web management dashboard.

Modules§

api
Cortiq extension API endpoints.
dashboard
Web management dashboard — served as embedded static content.
openai
OpenAI-compatible API endpoints, backed by the real inference pipeline. Generation runs in spawn_blocking behind a Mutex — a panic inside the pipeline becomes a 500, never a dead process.
streaming
SSE (Server-Sent Events) streaming for OpenAI-compatible chat completions.

Structs§

AppState
Shared application state: runtime (masks, metrics) + the inference pipeline behind a Mutex (single-sequence decode; requests queue).

Functions§

build_router
Build the full router with all endpoints.