Enum TextSamplingStrategy 

pub enum TextSamplingStrategy {
    Standard,
    MirostatV2 {
        tau: f32,
        eta: f32,
    },
}

Backend-neutral token-sampling strategy for one text-generation session.

Variants

Standard

Apply the resolved top-k, top-p, min-p, and penalty controls.

MirostatV2

Adapt the surprise cutoff toward tau bits at rate eta.

Fields

tau: f32

Target surprise in bits.

eta: f32

Adaptation rate.

Trait Implementations

impl Clone for TextSamplingStrategy

fn clone(&self) -> TextSamplingStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TextSamplingStrategy

impl Debug for TextSamplingStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TextSamplingStrategy

fn default() -> TextSamplingStrategy

Returns the “default value” for a type.

impl PartialEq for TextSamplingStrategy

fn eq(&self, other: &TextSamplingStrategy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TextSamplingStrategy