Struct ChatResponse 

pub struct ChatResponse<CHOICE> {
    pub created: u64,
    pub model: Option<String>,
    pub system_fingerprint: Option<String>,
    pub choices: Vec<CHOICE>,
    pub usage: Option<UsageResponse>,
}

A chat response, in non-chunked format

Fields

created: u64

Unix timestamp in seconds

model: Option<String>

The model that was used

system_fingerprint: Option<String>

A fingerprint for the system prompt

choices: Vec<CHOICE>

The chat choices

usage: Option<UsageResponse>

Token usage information

Implementations

impl ChatResponse<ChatChoice>

pub fn new_for_collection(num_choices: usize) -> Self

Create a new, empty ChatResponse designed for collecting streaming chat responses.

pub fn merge_delta(&mut self, chunk: &ChatResponse<ChatChoiceDelta>)

Merge a streaming delta into this response.

Trait Implementations

impl<CHOICE: Clone> Clone for ChatResponse<CHOICE>

fn clone(&self) -> ChatResponse<CHOICE>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<CHOICE: Debug> Debug for ChatResponse<CHOICE>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de, CHOICE> Deserialize<'de> for ChatResponse<CHOICE>

where CHOICE: Deserialize<'de>,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl From<ChatResponse<ChatChoice>> for StreamingChatResponse

For when we need to make a non-streaming chat response appear like it was a streaming response

fn from(value: SingleChatResponse) -> Self

Converts to this type from the input type.

impl<CHOICE> Serialize for ChatResponse<CHOICE>

where CHOICE: Serialize,

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.