Module batch

Module batch 

Source
Expand description

Batch API builders.

This module provides ergonomic builders for OpenAI Batch API operations, which allow you to send asynchronous groups of requests with 24-hour turnaround and 50% cost reduction compared to synchronous API calls.

Structs§

BatchJobBuilder
Builder for creating batch jobs.
BatchJobCancelBuilder
Builder for cancelling batch jobs.
BatchJobListBuilder
Builder for listing batch jobs.
BatchJobRetrievalBuilder
Builder for retrieving batch job details.

Enums§

BatchCompletionWindow
Completion window for batch jobs.
BatchEndpoint
Supported endpoints for batch processing.

Functions§

batch_chat_completions
Helper function to create a chat completions batch job.
batch_completions
Helper function to create a completions batch job.
batch_embeddings
Helper function to create an embeddings batch job.
batch_job_with_metadata
Helper function to create a batch job with metadata.
cancel_batch_job
Helper function to cancel a batch job.
get_batch_job
Helper function to retrieve a specific batch job.
list_batch_jobs
Helper function to list batch jobs.