optimize_and_chunk_batch

Function optimize_and_chunk_batch 

Source
pub async fn optimize_and_chunk_batch(
    client: &Client<OpenaiEnvironmentImpl>,
    requests: Vec<EnhancedBatchRequest>,
    chunk_size: usize,
) -> Result<Vec<BatchProcessingMetrics>>
Expand description

Optimize and chunk batch requests for better performance

ยงErrors

Returns an error if batch chunking fails or if processing of any chunk encounters errors.