Struct ChatMessageRequest 

pub struct ChatMessageRequest {
    pub model_name: String,
    pub messages: Vec<ChatMessage>,
    pub tools: Vec<ToolInfo>,
    pub options: Option<ModelOptions>,
    pub template: Option<String>,
    pub format: Option<FormatType>,
    pub keep_alive: Option<KeepAlive>,
    pub think: Option<bool>,
    /* private fields */
}

A chat message request to Ollama.

Fields

model_name: String

messages: Vec<ChatMessage>

tools: Vec<ToolInfo>

options: Option<ModelOptions>

template: Option<String>

format: Option<FormatType>

keep_alive: Option<KeepAlive>

think: Option<bool>

Implementations

impl ChatMessageRequest

pub fn new(model_name: String, messages: Vec<ChatMessage>) -> ChatMessageRequest

pub fn options(self, options: ModelOptions) -> ChatMessageRequest

Additional model parameters listed in the documentation for the Modelfile

pub fn template(self, template: String) -> ChatMessageRequest

The full prompt or prompt template (overrides what is defined in the Modelfile)

pub fn format(self, format: FormatType) -> ChatMessageRequest

The format to return a response in.

pub fn keep_alive(self, keep_alive: KeepAlive) -> ChatMessageRequest

Used to control how long a model stays loaded in memory, by default models are unloaded after 5 minutes of inactivity

pub fn tools(self, tools: Vec<ToolInfo>) -> ChatMessageRequest

Tools that are available to the LLM.

pub fn think(self, think: bool) -> ChatMessageRequest

Used to control whether thinking/reasoning models will think before responding

Trait Implementations

impl Clone for ChatMessageRequest

fn clone(&self) -> ChatMessageRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatMessageRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Serialize for ChatMessageRequest

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.