litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

//! Baseten Provider
//!
//! Baseten provides serverless inference for machine learning models.
//! This implementation provides access to Baseten's OpenAI-compatible API
//! for both Model API and dedicated deployments.

mod config;
mod error;
mod provider;

#[cfg(test)]
mod tests;

pub use config::BasetenConfig;
pub use error::BasetenError;
pub use provider::BasetenProvider;