Expand description
Axum-based HTTP server implementation for Ferrum
This module provides a concrete implementation of the HttpServer trait using the Axum web framework, with OpenAI-shaped endpoint compatibility.
Structs§
- AppState
- Application state shared across handlers — one optional engine per modality. Handlers reach into the field they need and 503 when it’s not loaded.
- Axum
Server - Axum-based server implementation.
- Lora
Adapter Model - Lora
Model Registry
Functions§
- init_
prometheus_ recorder - Initialize the Prometheus metrics recorder.