Type Alias StreamingChatResponse 

pub type StreamingChatResponse = ChatResponse<ChatChoiceDelta>;

A chunk of streaming response

Aliased Type

pub struct StreamingChatResponse {
    pub created: u64,
    pub model: Option<String>,
    pub system_fingerprint: Option<String>,
    pub choices: Vec<ChatChoiceDelta>,
    pub usage: Option<UsageResponse>,
}

Fields

created: u64

Unix timestamp in seconds

model: Option<String>

The model that was used

system_fingerprint: Option<String>

A fingerprint for the system prompt

choices: Vec<ChatChoiceDelta>

The chat choices

usage: Option<UsageResponse>

Token usage information

Trait Implementations

impl From<ChatResponse<ChatChoice>> for StreamingChatResponse

For when we need to make a non-streaming chat response appear like it was a streaming response

fn from(value: SingleChatResponse) -> Self

Converts to this type from the input type.