litellm-rs 0.6.0

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation

litellm-rs

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 26 feature flags, 6 of them enabled by default.

default

metrics (default)

redis (default)

sqlite (default)

tracing (default)

storage (default)

gateway (default)

a2a

This feature flag does not enable additional features.

analytics

aws-secrets

azure-secrets

cloud-secrets

enterprise

full

gcp-secrets

lite

mcp

This feature flag does not enable additional features.

mcp-validation

postgres

providers-extended

This feature flag does not enable additional features.

providers-extra

This feature flag does not enable additional features.

s3

user-management

vault-secrets

vector-db

webhooks

This feature flag does not enable additional features.

websockets

This feature flag does not enable additional features.