pub struct InferenceOptions {
pub tool_choice: Option<ToolChoice>,
pub model: Option<String>,
}Expand description
Model and tool overrides applied when generating the assistant response.
Fields§
§tool_choice: Option<ToolChoice>Preferred tool to invoke. Defaults to null when ChatKit should auto-select.
model: Option<String>Model name that generated the response. Defaults to null when using the session default.
Trait Implementations§
Source§impl Clone for InferenceOptions
impl Clone for InferenceOptions
Source§fn clone(&self) -> InferenceOptions
fn clone(&self) -> InferenceOptions
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceOptions
impl Debug for InferenceOptions
Source§impl Default for InferenceOptions
impl Default for InferenceOptions
Source§fn default() -> InferenceOptions
fn default() -> InferenceOptions
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for InferenceOptions
impl<'de> Deserialize<'de> for InferenceOptions
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for InferenceOptions
impl PartialEq for InferenceOptions
Source§impl Serialize for InferenceOptions
impl Serialize for InferenceOptions
impl StructuralPartialEq for InferenceOptions
Auto Trait Implementations§
impl Freeze for InferenceOptions
impl RefUnwindSafe for InferenceOptions
impl Send for InferenceOptions
impl Sync for InferenceOptions
impl Unpin for InferenceOptions
impl UnwindSafe for InferenceOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more