Struct CompletionRequest 

pub struct CompletionRequest {
    pub node: String,
    pub model: ModelSelection,
    pub system: Option<String>,
    pub prompt: String,
    pub context: Vec<(String, Value)>,
    pub response_type: String,
    pub shape: ResponseShape,
    pub max_tokens: u32,
}

One model call.

Fields

node: String

Node id, for cassette matching and error messages.

model: ModelSelection

system: Option<String>

prompt: String

context: Vec<(String, Value)>

Named context values rendered into the request, in declaration order.

response_type: String

The Ingot type the caller declared.

shape: ResponseShape

max_tokens: u32

Upper bound on output tokens for this call.

Implementations

impl CompletionRequest

pub fn digest(&self) -> String

A stable digest of everything that determines the answer.

Cassette replay compares this, so an edited prompt produces a loud mismatch instead of a stale answer from the previous recording.

Trait Implementations

impl Clone for CompletionRequest

fn clone(&self) -> CompletionRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompletionRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.