litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

//! Replicate Provider
//!
//! Replicate is a platform that lets you run machine learning models with a cloud API.
//! This provider supports both chat completions (via Llama models) and image generation
//! (via Stable Diffusion, SDXL, Flux, and other models).

pub mod client;
pub mod config;
pub mod error;
pub mod models;
pub mod prediction;
pub mod provider;
pub mod streaming;

pub use client::ReplicateClient;
pub use config::ReplicateConfig;
pub use error::ReplicateErrorMapper;
pub use models::{ReplicateModelRegistry, get_replicate_registry};
pub use prediction::{PredictionResponse, PredictionStatus};
pub use provider::ReplicateProvider;