process_batch_concurrent

ai_lib::api::chat::batch_utils

Function process_batch_concurrent 

Source 
pub async fn process_batch_concurrent<T: ChatApi + ?Sized>(
    api: &T,
    requests: Vec<ChatCompletionRequest>,
    concurrency_limit: Option<usize>,
) -> Result<Vec<Result<ChatCompletionResponse, AiLibError>>, AiLibError>
Expand description

Default implementation for concurrent batch processing