litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

//! OpenAI-Like Provider - Generic OpenAI-Compatible API Provider
//!
//! This provider allows connecting to any OpenAI-compatible API endpoint.
//! It supports custom API bases, API keys, and headers, making it ideal for:
//! - Self-hosted models (LMStudio, Ollama, vLLM)
//! - Third-party OpenAI-compatible services
//! - Custom proxy endpoints
//! - Testing and development

pub mod config;
pub mod error;
pub mod models;
pub mod provider;
pub mod streaming;

// Re-exports for easy access
pub use config::OpenAILikeConfig;
pub use error::OpenAILikeError;
pub use models::OpenAILikeModelRegistry;
pub use provider::OpenAILikeProvider;