pub struct Request {
pub input_file_id: String,
pub endpoint: Endpoint,
pub completion_window: CompletionWindow,
pub metadata: Option<Metadata>,
pub output_expires_after: Option<BatchFileExpirationAfter>,
}
Fields§
§input_file_id: String
The ID of an uploaded file that contains requests for the new batch.
See upload file for how to upload a file.
Your input file must be formatted as a JSONL file, and must be uploaded with the purpose batch
. The file can contain up to 50,000 requests, and can be up to 200 MB in size.
endpoint: Endpoint
The endpoint to be used for all requests in the batch. Currently /v1/responses
, /v1/chat/completions
, /v1/embeddings
, and /v1/completions
are supported. Note that /v1/embeddings
batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.
completion_window: CompletionWindow
The time frame within which the batch should be processed. Currently only 24h
is supported.
metadata: Option<Metadata>
§output_expires_after: Option<BatchFileExpirationAfter>
Implementations§
Source§impl Request
impl Request
Sourcepub fn builder() -> RequestBuilder<((), (), (), (), ())>
pub fn builder() -> RequestBuilder<((), (), (), (), ())>
Create a builder for building Request
.
On the builder, call .input_file_id(...)
, .endpoint(...)
, .completion_window(...)
, .metadata(...)
(optional), .output_expires_after(...)
(optional) to set the values of the fields.
Finally, call .build()
to create the instance of Request
.