Enum ChatEvent

pub enum ChatEvent {
    Delta {
        content: String,
        logprobs: Vec<Distribution>,
    },
    Finished {
        reason: String,
    },
    Summary {
        usage: Usage,
    },
}

Variants

Delta

Fields

content: String

Chat completion chunk generated by the model when streaming is enabled. The role is always “assistant”.

logprobs: Vec<Distribution>

Log probabilities of the completion tokens if requested via logprobs parameter in request.

Finished

The last chunk of a chat completion stream.

Fields

reason: String

The reason the model stopped generating tokens.

Summary

Summary of the chat completion stream.

Fields

usage: Usage

Trait Implementations

impl Debug for ChatEvent

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.