Struct SamplingFallback 

pub struct SamplingFallback {
    pub temperature: f32,
    pub repeat_penalty: f32,
    pub top_p: f32,
    pub top_k: u32,
    pub min_p: f32,
    pub frequency_penalty_as_repeat: bool,
}

An embedding’s defaults, below request and operator values: temperature and repetition replace the model’s; truncation applies only when the model publishes none.

Fields

temperature: f32

repeat_penalty: f32

top_p: f32

top_k: u32

min_p: f32

frequency_penalty_as_repeat: bool

Interpret a lone frequency_penalty as multiplicative (1 + value). An explicit presence_penalty or repeat_penalty retains additive frequency semantics; presence_penalty alone disables fallback repeat.

Trait Implementations

impl Clone for SamplingFallback

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SamplingFallback

impl Debug for SamplingFallback

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SamplingFallback

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SamplingFallback