Struct M3ChatRequest 

pub struct M3ChatRequest {
    pub model: String,
    pub messages: Vec<M3Message>,
    pub temperature: Option<f32>,
    pub max_tokens: Option<u32>,
    pub top_p: Option<f32>,
    pub stream: bool,
    pub stop: Option<Vec<String>>,
}

Chat completion request in M3 format

Fields

model: String

Model identifier

messages: Vec<M3Message>

Chat messages

temperature: Option<f32>

Temperature (0.0-2.0, quantized to 0.01 precision)

max_tokens: Option<u32>

Maximum tokens to generate

top_p: Option<f32>

Top-p sampling

stream: bool

Enable streaming

stop: Option<Vec<String>>

Stop sequences

Trait Implementations

impl Clone for M3ChatRequest

fn clone(&self) -> M3ChatRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for M3ChatRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for M3ChatRequest

fn default() -> M3ChatRequest

Returns the “default value” for a type.