omnillm 0.1.5

Production-grade LLM API gateway with multi-key load balancing, per-key rate limiting, circuit breaking, and cost tracking
Documentation
1
2
3
4
5
6
//! Key management: pool, lease, registry, and per-key state.

pub(crate) mod inner;
pub mod lease;
pub mod pool;
pub mod registry;