litellm-rs 0.4.16

A high-performance AI Gateway written in Rust, providing OpenAI-compatible APIs with intelligent routing, load balancing, and enterprise features
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
//! Batch processor module
//!
//! This module provides the batch processing functionality split into logical components:
//! - `core`: Core BatchProcessor struct and public CRUD methods
//! - `validation`: Request and item validation logic
//! - `execution`: Batch execution and processing logic
//! - `utils`: Utility methods for status updates and progress tracking

pub mod core;
mod execution;
mod utils;
mod validation;