Struct SpeculativeType 

pub struct SpeculativeType(pub i32);

A speculative-decoding strategy, as llama.cpp names it.

Values match common_speculative_type. Rather than pin discriminants that upstream reorders, this keeps the raw value and converts through llama.cpp’s own name table.

Tuple Fields

0: i32

Implementations

impl SpeculativeType

pub fn name(self) -> Result<String, RuntimeError>

llama.cpp’s name for this type, e.g. "draft-eagle3".

Errors

Returns RuntimeError::Failed if llama.cpp cannot name it.

pub fn from_name(name: &str) -> Result<Self, RuntimeError>

Parse a name from llama.cpp’s own table.

Errors

Returns RuntimeError::InvalidArg if the name is not recognised — upstream reports that with a sentinel value rather than an error, which the shim translates so an unknown name cannot be stored and silently select nothing. RuntimeError::Nul for an interior NUL.

pub fn all_names() -> Result<String, RuntimeError>

Every type name llama.cpp recognises, as one string — what its CLI prints in help text.

Errors

Returns RuntimeError::Failed if llama.cpp throws.

Trait Implementations

impl Clone for SpeculativeType

fn clone(&self) -> SpeculativeType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SpeculativeType

impl Debug for SpeculativeType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for SpeculativeType

impl Hash for SpeculativeType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for SpeculativeType

fn eq(&self, other: &SpeculativeType) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SpeculativeType