Struct NucleusConfig 

pub struct NucleusConfig {
    pub p: f64,
    pub temperature: f64,
    pub min_tokens: usize,
}

Configuration for nucleus_sample and nucleus_sample_batch.

Fields

p: f64

Cumulative-probability threshold defining the “nucleus”, in (0, 1].

temperature: f64

Softmax temperature (> 0).

min_tokens: usize

Minimum number of tokens to keep (≥ 1). This safeguards against pathologically tiny nuclei when p is very small.

Trait Implementations

impl Clone for NucleusConfig

fn clone(&self) -> NucleusConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for NucleusConfig

impl Debug for NucleusConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for NucleusConfig

fn default() -> Self

Returns the “default value” for a type.