litellm-rs 0.8.2

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13

//! MCP configuration and shared protocol/schema support.
//!
//! `gateway,mcp` exposes the authenticated stateless Streamable HTTP proxy in
//! `server::routes::mcp`; requests can move between instances. See
//! `docs/gateway/mcp.md` for supported transport and authentication.
//! Protocol/schema helpers are library support, not a separate runtime client.

pub mod config;
pub mod error;
pub mod protocol;
pub mod tools;
pub mod transport;
pub mod validation;