Crate batch_mode_batch_scribe

Source

Structs§

BatchRequestId
CustomRequestId
LanguageModelBatchAPIRequest
Represents the complete request structure.
LanguageModelMessage
Individual message details in the request body.
LanguageModelRequestBody
Body details of the API request.

Enums§

BatchInputCreationError
HttpMethod
Enumeration of possible HTTP methods.
LanguageModelApiUrl
Enumeration of API URLs.
LanguageModelBatchCreationError
LanguageModelMessageRole
Enumeration of roles in a message.
ParseTokenDescriptionLineError
TokenizerError

Functions§

construct_batches
Break requests into workable batches.
create_batch_input_file
make_valid_lmb_api_request_json_mock