Struct CreateChatCompletionStreamResponse 

pub struct CreateChatCompletionStreamResponse {
    pub id: String,
    pub choices: Vec<ChatChoiceStream>,
    pub created: u32,
    pub model: String,
    pub service_tier: Option<ServiceTierResponse>,
    pub system_fingerprint: Option<String>,
    pub object: String,
    pub usage: Option<CompletionUsage>,
    pub nvext: Option<Value>,
}

Represents a streamed chunk of a chat completion response returned by model, based on the provided input.

Fields

id: String

A unique identifier for the chat completion. Each chunk has the same ID.

choices: Vec<ChatChoiceStream>

A list of chat completion choices. Can contain more than one elements if n is greater than 1. Can also be empty for the last chunk if you set stream_options: {"include_usage": true}.

created: u32

The Unix timestamp (in seconds) of when the chat completion was created. Each chunk has the same timestamp.

model: String

The model to generate the completion.

service_tier: Option<ServiceTierResponse>

The service tier used for processing the request. This field is only included if the service_tier parameter is specified in the request.

system_fingerprint: Option<String>

This fingerprint represents the backend configuration that the model runs with. Can be used in conjunction with the seed request parameter to understand when backend changes have been made that might impact determinism.

object: String

The object type, which is always chat.completion.chunk.

usage: Option<CompletionUsage>

An optional field that will only be present when you set stream_options: {"include_usage": true} in your request. When present, it contains a null value except for the last chunk which contains the token usage statistics for the entire request.

nvext: Option<Value>

NVIDIA extension field for response metadata

Trait Implementations

impl Clone for CreateChatCompletionStreamResponse

fn clone(&self) -> CreateChatCompletionStreamResponse

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ComposeSchema for CreateChatCompletionStreamResponse

fn compose(generics: Vec<RefOr<Schema>>) -> RefOr<Schema>

impl Debug for CreateChatCompletionStreamResponse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CreateChatCompletionStreamResponse

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for CreateChatCompletionStreamResponse

fn eq(&self, other: &CreateChatCompletionStreamResponse) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for CreateChatCompletionStreamResponse

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CreateChatCompletionStreamResponse

impl ToSchema for CreateChatCompletionStreamResponse

fn name() -> Cow<'static, str>

Return name of the schema.

fn schemas(schemas: &mut Vec<(String, RefOr<Schema>)>)

Implement reference utoipa::openapi::schema::Schemas for this type.