ferrox-server 0.8.0

OpenAI-compatible HTTP server for the Ferrox inference engine
1
2
3
4
5
6
# ferrox-server

OpenAI-compatible HTTP server for Ferrox (`ferrox-server` binary).

Serves chat/completions against a GGUF (or Kimi safetensors dir) via
`FERROX_MODEL_PATH`. See [`docs/API.md`](../../docs/API.md).