pub struct MessageOptions {
pub temperature: Option<f32>,
pub max_tokens: Option<u32>,
pub model: Option<String>,
pub tools: Option<Vec<Tool>>,
pub tool_choice: Option<ToolChoice>,
pub stop_sequences: Option<Vec<String>>,
pub top_p: Option<f32>,
pub top_k: Option<u32>,
pub metadata: Option<Metadata>,
}Expand description
Options for LLM message requests.
Fields§
§temperature: Option<f32>Sampling temperature (0.0-1.0).
max_tokens: Option<u32>Maximum tokens to generate.
model: Option<String>Model to use.
tools: Option<Vec<Tool>>Tools available for the model to use.
tool_choice: Option<ToolChoice>How the model should use tools.
stop_sequences: Option<Vec<String>>Custom stop sequences.
top_p: Option<f32>Nucleus sampling parameter.
top_k: Option<u32>Top-K sampling parameter.
metadata: Option<Metadata>Request metadata.
Trait Implementations§
Source§impl Clone for MessageOptions
impl Clone for MessageOptions
Source§fn clone(&self) -> MessageOptions
fn clone(&self) -> MessageOptions
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MessageOptions
impl Debug for MessageOptions
Source§impl Default for MessageOptions
impl Default for MessageOptions
Source§fn default() -> MessageOptions
fn default() -> MessageOptions
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for MessageOptions
impl RefUnwindSafe for MessageOptions
impl Send for MessageOptions
impl Sync for MessageOptions
impl Unpin for MessageOptions
impl UnwindSafe for MessageOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more