batch_mode_batch_workflow

Function construct_batches

Source 
pub fn construct_batches(
    requests: &[LanguageModelBatchAPIRequest],
    requests_per_batch: usize,
    throw_on_too_small_batch: bool,
) -> Result<Enumerate<Chunks<'_, LanguageModelBatchAPIRequest>>, LanguageModelBatchCreationError>
Expand description

Break requests into workable batches.