Struct async_openai::Batches

pub struct Batches<'c, C: Config> { /* private fields */ }

Create large batches of API requests for asynchronous processing. The Batch API returns completions within 24 hours for a 50% discount.

Related guide: Batch

Implementations

impl<'c, C: Config> Batches<'c, C>

pub fn new(client: &'c Client<C>) -> Self

pub async fn create(&self, request: BatchRequest) -> Result<Batch, OpenAIError>

Creates and executes a batch from an uploaded file of requests

pub async fn list<Q>( &self, query: &Q ) -> Result<ListBatchesResponse, OpenAIError>

where Q: Serialize + ?Sized,

List your organization’s batches.

pub async fn retrieve(&self, batch_id: &str) -> Result<Batch, OpenAIError>

Retrieves a batch.

pub async fn cancel(&self, batch_id: &str) -> Result<Batch, OpenAIError>

Cancels an in-progress batch.