pub async fn process_batch_sequential<T: ChatApi + ?Sized>(
api: &T,
requests: Vec<ChatCompletionRequest>,
) -> Result<Vec<Result<ChatCompletionResponse, AiLibError>>, AiLibError>
Expand description
Sequential batch processing implementation
pub async fn process_batch_sequential<T: ChatApi + ?Sized>(
api: &T,
requests: Vec<ChatCompletionRequest>,
) -> Result<Vec<Result<ChatCompletionResponse, AiLibError>>, AiLibError>
Sequential batch processing implementation