docs.rs failed to build hyperinfer-server-0.1.1
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
hyperinfer-server
High-performance LLM Gateway server built with Axum.
Features
- Multi-provider LLM routing (OpenAI, Anthropic, Azure, etc.)
- Rate limiting and request queuing
- API key management and authentication
- PostgreSQL persistence
- Redis caching
- OpenTelemetry observability
Usage
use Server;
async
License
MIT