litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26

//! HuggingFace Provider
//!
//! HuggingFace Hub integration supporting Inference Providers and Inference Endpoints.
//! This implementation provides access to ML models hosted on the HuggingFace Hub.
//!
//! ## Features
//! - Serverless Inference Providers (Together AI, Sambanova, Fireworks, etc.)
//! - Dedicated Inference Endpoints
//! - Text Generation Inference (TGI)
//! - Embeddings via text-embeddings-inference
//! - OpenAI-compatible API format

mod config;
mod embedding;
mod error;
mod models;
mod provider;

#[cfg(test)]
mod tests;

// Re-exports for easy access
pub use config::HuggingFaceConfig;
pub use error::HuggingFaceError;
pub use models::{HuggingFaceTask, InferenceProvider};
pub use provider::HuggingFaceProvider;