furnace-server 0.11.0

Fast, unified, Rust-native, Axum-compatible inference endpoints for Burn models and LLMs: KServe / Triton and OpenAI APIs from one pure-Rust server
Documentation

furnace-server

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 10 feature flags, 1 of them enabled by default.

default

onnx (default)

cuda

embed-weights

grpc

image

llm

metal

test-models

This feature flag does not enable additional features.

tls

wgpu