Expand description
Streaming chat completion response.
Structs§
- Chat
Completion Chunk - Choice
Delta - Choice
Delta Function Call - Choice
Delta Tool Call - Choice
Delta Tool Call Function - Completion
Chunk Choice - Completion
Tokens Details - Completion
Usage - Logprobe
Content - A list of message content tokens with log probability information.
- Prompt
Tokens Details - TopLogprob
- List of the most likely tokens and their log probability, at this token position. In rare cases, there may be fewer than the number of requested top_logprobs returned.