pub struct LlmParams {
pub messages: Vec<ChatMessage>,
pub system: Option<String>,
pub max_tokens: u32,
pub temperature: f32,
pub top_p: Option<f32>,
pub stop: Option<Vec<String>>,
pub json_schema: Option<Value>,
pub reasoning: Option<String>,
}Fields§
§messages: Vec<ChatMessage>§system: Option<String>System prompt prepended to the conversation. Engines that don’t accept a separate system role inline it as the first chat turn.
max_tokens: u32§temperature: f32§top_p: Option<f32>§stop: Option<Vec<String>>§json_schema: Option<Value>Strict-JSON output schema. Engine-specific; passed through
verbatim to the backend (e.g. llama.cpp’s --grammar JSON).
reasoning: Option<String>Reasoning effort hint. Currently honoured by Gemini-style backends only; ignored elsewhere.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for LlmParams
impl<'de> Deserialize<'de> for LlmParams
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LlmParams
impl RefUnwindSafe for LlmParams
impl Send for LlmParams
impl Sync for LlmParams
impl Unpin for LlmParams
impl UnsafeUnpin for LlmParams
impl UnwindSafe for LlmParams
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
Source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can
then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.Source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be
further downcast into Rc<ConcreteType> where ConcreteType implements Trait.Source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.Source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.