Struct MtpSpeculativeParams 

pub struct MtpSpeculativeParams {
    pub n_max: i32,
    pub n_min: i32,
    pub p_min: f32,
}

Parameters for same-model MTP speculative decoding.

Fields

n_max: i32

Maximum number of draft tokens to propose.

n_min: i32

Minimum number of draft tokens required before returning a draft.

p_min: f32

Minimum draft probability accepted by llama.cpp’s MTP drafter.

Trait Implementations

impl Clone for MtpSpeculativeParams

fn clone(&self) -> MtpSpeculativeParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for MtpSpeculativeParams

impl Debug for MtpSpeculativeParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MtpSpeculativeParams

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for MtpSpeculativeParams

fn eq(&self, other: &MtpSpeculativeParams) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for MtpSpeculativeParams