Enum GenerationMode 

pub enum GenerationMode {
    Fast,
    Slow,
    Hybrid,
}

Inference decoding strategy (HF generation_mode).

Variants

Fast

MTP only — parallel box blocks.

Slow

Autoregressive one token at a time.

Hybrid

MTP with AR fallback on uncertain boxes (default).

Implementations

impl GenerationMode

pub fn parse(s: &str) -> Option<GenerationMode>

Trait Implementations

impl Clone for GenerationMode

fn clone(&self) -> GenerationMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for GenerationMode

impl Debug for GenerationMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for GenerationMode

fn default() -> GenerationMode

Returns the “default value” for a type.

impl Eq for GenerationMode

impl PartialEq for GenerationMode

fn eq(&self, other: &GenerationMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for GenerationMode