Struct CompletionResponse

pub struct CompletionResponse {
    pub id: String,
    pub choices: Vec<CompletionChoice>,
    pub created: u64,
    pub model: String,
    pub object: String,
    pub usage: Option<CompletionUsage>,
    pub system_fingerprint: Option<String>,
}

Legacy OpenAI CompletionResponse Represents a completion response from the API. Note: both the streamed and non-streamed response objects share the same shape (unlike the chat endpoint).

Fields

id: String

A unique identifier for the completion.

choices: Vec<CompletionChoice>

The list of completion choices the model generated for the input prompt.

created: u64

The Unix timestamp (in seconds) of when the completion was created.

model: String

The model used for completion.

object: String

The object type, which is always “text_completion”

usage: Option<CompletionUsage>

Usage statistics for the completion request.

system_fingerprint: Option<String>

This fingerprint represents the backend configuration that the model runs with. Can be used in conjunction with the seed request parameter to understand when backend changes have been made that might impact determinism.

NIM Compatibility: This field is not supported by the NIM; however it will be added in the future. The optional nature of this field will be relaxed when it is supported.

Implementations

impl CompletionResponse

pub async fn from_sse_stream( stream: DataStream<Result<Message, SseCodecError>>, ) -> Result<CompletionResponse>

pub async fn from_annotated_stream( stream: DataStream<Annotated<CompletionResponse>>, ) -> Result<CompletionResponse>

Trait Implementations

impl Clone for CompletionResponse

fn clone(&self) -> CompletionResponse

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompletionResponse

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl DeltaGeneratorExt<CompletionResponse> for DeltaGenerator

fn choice_from_postprocessor( &mut self, delta: BackendOutput, ) -> Result<CompletionResponse>

fn get_isl(&self) -> Option<u32>

Gets the current prompt token count (Input Sequence Length).

impl<'de> Deserialize<'de> for CompletionResponse

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CompletionResponse

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.