litellm-rs 0.6.0

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12

//! LLM Provider module
//!
//! This module provides the unified interface for all AI providers.
//!
//! `trait_definition::LLMProvider` plus `ProviderCapability` is the runtime
//! dispatch contract. `sub_traits` is exported only for deprecated library API
//! compatibility and must not be used by new router or gateway call sites.
//! The original `llm_provider.rs` has been split into smaller modules for better maintainability.

pub mod sub_traits;
pub mod trait_definition;
mod types;