Module api

Source
Expand description

Data types corresponding to requests and responses from the API

Structs§

Choice
A single completion result
Completion
Represents a non-streamed completion response
CompletionArgs
Options that affect the result
CompletionArgsBuilder
Builder for CompletionArgs.
EngineInfo
Engine description type
ErrorMessage
Error response object from the server
LogProbs
Represents a logprobs subdocument

Enums§

Engine
Engine types, known and unknown
FinishReason
Reason a prompt completion finished.