Struct BatchRequest

pub struct BatchRequest {
    pub input_file_id: String,
    pub endpoint: BatchEndpoint,
    pub completion_window: BatchCompletionWindow,
    pub metadata: Option<HashMap<String, Value>>,
}

Fields

input_file_id: String

The ID of an uploaded file that contains requests for the new batch.

See upload file for how to upload a file.

Your input file must be formatted as a JSONL file, and must be uploaded with the purpose batch. The file can contain up to 50,000 requests, and can be up to 100 MB in size.

endpoint: BatchEndpoint

The endpoint to be used for all requests in the batch. Currently /v1/chat/completions, /v1/embeddings, and /v1/completions are supported. Note that /v1/embeddings batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.

completion_window: BatchCompletionWindow

The time frame within which the batch should be processed. Currently only 24h is supported.

metadata: Option<HashMap<String, Value>>

Optional custom metadata for the batch.

Trait Implementations

impl Clone for BatchRequest

fn clone(&self) -> BatchRequest

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BatchRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BatchRequest

fn default() -> BatchRequest

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for BatchRequest

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for BatchRequest

fn eq(&self, other: &BatchRequest) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for BatchRequest

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for BatchRequest