Struct TopKConfig 

pub struct TopKConfig {
    pub k: usize,
    pub temperature: f64,
}

Configuration for top_k_sample and top_k_sample_batch.

Fields

k: usize

Number of highest-probability tokens to keep (k ≥ 1).

temperature: f64

Softmax temperature (> 0). Higher values flatten the distribution, lower values sharpen it.

Trait Implementations

impl Clone for TopKConfig

fn clone(&self) -> TopKConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TopKConfig

impl Debug for TopKConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TopKConfig

fn default() -> Self

Returns the “default value” for a type.