Enum PerRowSampler 

#[non_exhaustive]
pub enum PerRowSampler {
    TopK,
    TopP,
    MinP,
    TopKTopP,
}

Which per-row sampler to run (thresholds supplied as device arrays in the args, not the descriptor).

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

TopK

Per-row top-K (top_k_arr i32 required).

TopP

Per-row top-P (top_p_arr required).

MinP

Per-row min-P (min_p_arr required).

TopKTopP

Per-row top-K + top-P (top_k_arr i32 + top_p_arr f32 required).

Trait Implementations

impl Clone for PerRowSampler

fn clone(&self) -> PerRowSampler

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PerRowSampler

impl Debug for PerRowSampler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for PerRowSampler

impl PartialEq for PerRowSampler

fn eq(&self, other: &PerRowSampler) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for PerRowSampler