Struct InferenceRequestRecord 

pub struct InferenceRequestRecord {
    pub model: String,
    pub system: Vec<String>,
    pub messages: Vec<MessageRecord>,
    pub tool_names: Vec<String>,
    pub temperature: f32,
    pub max_tokens: usize,
}

The outbound request of one inference (a provider-agnostic digest - enough to reproduce/debug the call without depending on leviath-providers).

Fields

model: String

The model the request targeted.

system: Vec<String>

System-block texts, in order.

messages: Vec<MessageRecord>

The conversation messages sent.

tool_names: Vec<String>

The tool names offered to the model.

temperature: f32

The temperature used.

max_tokens: usize

The max output tokens requested.

Trait Implementations

impl Clone for InferenceRequestRecord

fn clone(&self) -> InferenceRequestRecord

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceRequestRecord

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferenceRequestRecord

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for InferenceRequestRecord

fn eq(&self, other: &InferenceRequestRecord) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for InferenceRequestRecord

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for InferenceRequestRecord