hyperinfer-server 0.1.1

High-performance LLM Gateway server built with Axum
docs.rs failed to build hyperinfer-server-0.1.1
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.

hyperinfer-server

High-performance LLM Gateway server built with Axum.

Features

  • Multi-provider LLM routing (OpenAI, Anthropic, Azure, etc.)
  • Rate limiting and request queuing
  • API key management and authentication
  • PostgreSQL persistence
  • Redis caching
  • OpenTelemetry observability

Usage

use hyperinfer_server::Server;

#[tokio::main]
async fn main() {
    let server = Server::new().await;
    server.run().await;
}

License

MIT