Struct SearchOptions 

pub struct SearchOptions {
    pub temperature: Option<f32>,
    pub top_p: Option<f32>,
    pub top_k: Option<i32>,
    pub max_output_tokens: Option<i32>,
    pub frequency_penalty: Option<f32>,
    pub presence_penalty: Option<f32>,
    pub seed: Option<i64>,
    pub early_stopping: Option<bool>,
    pub do_sample: Option<bool>,
}

Sampling / decoding parameters applied to a request or session.

Every field is optional; unset fields leave the model/engine default in place.

Fields

temperature: Option<f32>

Sampling temperature (higher = more random).

top_p: Option<f32>

Nucleus-sampling probability mass in (0, 1].

top_k: Option<i32>

Top-k sampling cutoff.

max_output_tokens: Option<i32>

Maximum number of tokens to generate.

frequency_penalty: Option<f32>

Frequency penalty in [-2.0, 2.0].

presence_penalty: Option<f32>

Presence penalty in [-2.0, 2.0].

seed: Option<i64>

Random seed for reproducible sampling.

early_stopping: Option<bool>

Stop as soon as a stop-sequence is matched.

do_sample: Option<bool>

Whether to sample (false = greedy decoding).

Trait Implementations

impl Clone for SearchOptions

fn clone(&self) -> SearchOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SearchOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SearchOptions

fn default() -> SearchOptions

Returns the “default value” for a type.

impl PartialEq for SearchOptions

fn eq(&self, other: &SearchOptions) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SearchOptions