litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12

//! AI and Model utilities
//!
//! This module provides token management, model support detection, and AI-related utilities.

pub mod counter;
pub mod models;
pub mod tokens;

// Re-export commonly used types and functions
pub use models::capabilities::ModelCapabilities;
pub use models::utils::ModelUtils;
pub use tokens::{TokenUsage, TokenUtils, TokenizerType};