Enum LlamaContextType 

#[repr(u32)]
pub enum LlamaContextType {
    Default = 0,
    Mtp = 1,
}

A rusty wrapper around llama_context_type.

Variants

Default = 0

Default context (standard inference).

Mtp = 1

Multi-token-prediction draft context, used as the draft side of speculative decoding. Pair with crate::mtp::MtpSession.

Trait Implementations

impl Clone for LlamaContextType

fn clone(&self) -> LlamaContextType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaContextType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<LlamaContextType> for llama_context_type

fn from(value: LlamaContextType) -> Self

Converts to this type from the input type.

impl From<u32> for LlamaContextType

fn from(value: llama_context_type) -> Self

Converts to this type from the input type.

impl PartialEq for LlamaContextType

fn eq(&self, other: &LlamaContextType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for LlamaContextType

impl Eq for LlamaContextType

impl StructuralPartialEq for LlamaContextType