Enum VocabMismatch 

pub enum VocabMismatch {
    Size {
        draft: usize,
        target: usize,
    },
}

The draft and target checkpoints do not agree about token ids.

This is the failure that costs a day, because it does not look like a failure. The rejection rule compares the drafter’s q(x) with the target’s p(x) at the same index x. If the two checkpoints number their vocabularies differently, those are probabilities of different tokens, the rule is comparing unrelated numbers, and the output is no longer the target’s distribution. What comes out is fluent text, with no error and a plausible-looking accept rate.

So it is refused at construction, which per this repo’s rule is coverage rather than a defect: a partly-implemented thing must stop and say what is missing instead of computing something else.

Vocabulary size is checked first because it is cheap and catches most real mismatches (a 32000-token Llama drafter against a 152064-token Qwen target). Equal sizes do not imply equal vocabularies, though, so the caller that has both tokenizers should also compare them; vocab_size is what a Decoder alone can see.

Variants

Size

Fields

draft: usize

target: usize

Trait Implementations

impl Clone for VocabMismatch

fn clone(&self) -> VocabMismatch

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VocabMismatch

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for VocabMismatch

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for VocabMismatch

impl Error for VocabMismatch

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl PartialEq for VocabMismatch

fn eq(&self, other: &VocabMismatch) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for VocabMismatch