Skip to main content

Crate embacle_server

Crate embacle_server 

Source
Expand description

§embacle-server

Unified OpenAI-compatible REST API + MCP server for embacle LLM runners.

§Endpoints

  • POST /v1/chat/completions — chat completion (streaming and non-streaming)
  • GET /v1/models — list available providers and models
  • GET /health — per-provider readiness check
  • POST /mcp — MCP Streamable HTTP (JSON-RPC 2.0, via embacle-mcp)

§Modules

  • completions — chat completion handler with multiplex fan-out
  • models — model listing endpoint
  • health — provider health checks
  • auth — optional bearer token authentication
  • streaming — SSE streaming for OpenAI-format responses
  • provider_resolverprovider:model string routing
  • router — Axum router wiring all endpoints (OpenAI + MCP)
  • state — re-export of unified state from embacle-mcp
  • runner — runner factory bridging to embacle core

Modules§

auth
completions
health
models
openai_types
provider_resolver
router
runner
state
streaming