pub struct LlmParams {
pub temperature: f64,
pub top_p: f64,
pub presence_penalty: f64,
pub frequency_penalty: f64,
pub max_tokens_multiplier: f64,
}Expand description
LLM inference parameters derived from genome traits
Fields§
§temperature: f64Controls randomness (0.0 = deterministic, 2.0 = very random)
top_p: f64Nucleus sampling threshold (1.0 = all tokens, 0.5 = top 50% probability mass)
presence_penalty: f64Penalty for tokens already in context (-2.0 to 2.0)
frequency_penalty: f64Penalty for token frequency (-2.0 to 2.0)
max_tokens_multiplier: f64Multiplier for max_tokens (applied to base value)
Implementations§
Trait Implementations§
Source§impl<'de> Deserialize<'de> for LlmParams
impl<'de> Deserialize<'de> for LlmParams
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Copy for LlmParams
Auto Trait Implementations§
impl Freeze for LlmParams
impl RefUnwindSafe for LlmParams
impl Send for LlmParams
impl Sync for LlmParams
impl Unpin for LlmParams
impl UnwindSafe for LlmParams
Blanket Implementations§
§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§unsafe fn clone_to_uninit(&self, dest: *mut u8)
unsafe fn clone_to_uninit(&self, dest: *mut u8)
🔬This is a nightly-only experimental API. (
clone_to_uninit)