litellm-rs 0.8.2

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation

litellm-rs

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 24 feature flags, 3 of them enabled by default.

default

lite (default)

metrics (default)

tracing (default)

a2a

aws-secrets

azure-secrets

cloud-secrets

enterprise

full

gateway

gcp-secrets

mcp

mcp-validation

postgres

providers-extended

This feature flag does not enable additional features.

providers-extra

This feature flag does not enable additional features.

redis

runway-media

s3

sqlite

storage

vault-secrets

vector-db

websockets