Enum SamplerKind 

#[non_exhaustive]
pub enum SamplerKind {
    TopK {
        top_k: i32,
    },
    TopP {
        top_p: f32,
    },
    MinP {
        min_p: f32,
    },
    TopKTopP {
        top_k: i32,
        top_p: f32,
    },
}

Which sort-free sampler to run.

Note: only PartialEq is derived (not Eq) because top_p / min_p are f32, and f32 doesn’t satisfy Eq (NaN != NaN).

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

TopK

Keep only the top-K cells (K = top_k).

Fields

top_k: i32

Cells kept per row. Must be in [1, vocab_size].

TopP

Keep the smallest top-prob set whose cumulative mass > top_p.

Fields

top_p: f32

Cumulative-mass cutoff in (0, 1].

MinP

Keep cells prob >= min_p * row_max.

Fields

min_p: f32

Multiplier of the per-row max prob in (0, 1].

TopKTopP

Combined top-K then top-P filter. Canonical decode sampler.

Fields

top_k: i32

Cells kept per row. Must be in [1, vocab_size].

top_p: f32

Cumulative-mass cutoff in (0, 1].

Trait Implementations

impl Clone for SamplerKind

fn clone(&self) -> SamplerKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SamplerKind

impl Debug for SamplerKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SamplerKind

fn eq(&self, other: &SamplerKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SamplerKind