#[repr(C)]pub struct BaseRTSamplingConfig {
pub temperature: c_float,
pub top_k: c_int,
pub top_p: c_float,
pub min_p: c_float,
pub repeat_penalty: c_float,
pub presence_penalty: c_float,
pub frequency_penalty: c_float,
pub seed: u32,
pub n_logit_bias: i32,
pub logit_bias_tokens: *const i32,
pub logit_bias_values: *const c_float,
}Expand description
Sampling configuration for text generation.
Extended in baseRT 0.2 with OpenAI-compat presence / frequency penalties,
a deterministic-sample seed, and a per-token logit_bias map. New
fields are appended; older callers using Default::default() keep the
classic five values plus zeroed extensions (disabled).
Fields§
§temperature: c_float§top_k: c_int§top_p: c_float§min_p: c_float§repeat_penalty: c_float§presence_penalty: c_float§frequency_penalty: c_float§seed: u32§n_logit_bias: i32§logit_bias_tokens: *const i32§logit_bias_values: *const c_floatTrait Implementations§
Source§impl Clone for BaseRTSamplingConfig
impl Clone for BaseRTSamplingConfig
impl Copy for BaseRTSamplingConfig
Source§impl Debug for BaseRTSamplingConfig
impl Debug for BaseRTSamplingConfig
Auto Trait Implementations§
impl !Send for BaseRTSamplingConfig
impl !Sync for BaseRTSamplingConfig
impl Forget for BaseRTSamplingConfig
impl Freeze for BaseRTSamplingConfig
impl RefUnwindSafe for BaseRTSamplingConfig
impl Unpin for BaseRTSamplingConfig
impl UnsafeUnpin for BaseRTSamplingConfig
impl UnwindSafe for BaseRTSamplingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more