Module streaming

Module streaming 

Source

Structs§

ChatCompletionChunk
ChoiceDelta
ChoiceDeltaFunctionCall
ChoiceDeltaToolCall
ChoiceDeltaToolCallFunction
CompletionChunkChoice
CompletionTokensDetails
CompletionUsage
LogprobeContent
A list of message content tokens with log probability information.
PromptTokensDetails
TopLogprob
List of the most likely tokens and their log probability, at this token position. In rare cases, there may be fewer than the number of requested top_logprobs returned.

Enums§

ChatCompletionChunkObject
ChoiceDeltaToolCallType
ChoiceLogprobs
CompletionContent
CompletionRole
FinishReason
ServiceTier
The service tier used for processing the request.