Enum KvCacheType 

pub enum KvCacheType {
    Unknown(ggml_type),
    F32,
    F16,
    Q4_0,
    Q4_1,
    Q5_0,
    Q5_1,
    Q8_0,
    Q8_1,
    Q2_K,
    Q3_K,
    Q4_K,
    Q5_K,
    Q6_K,
    Q8_K,
    IQ2_XXS,
    IQ2_XS,
    IQ3_XXS,
    IQ1_S,
    IQ4_NL,
    IQ3_S,
    IQ2_S,
    IQ4_XS,
    I8,
    I16,
    I32,
    I64,
    F64,
    IQ1_M,
    BF16,
    TQ1_0,
    TQ2_0,
    MXFP4,
}

A rusty wrapper around ggml_type for KV cache types.

Variants

Unknown(ggml_type)

Represents an unknown or not-yet-mapped ggml_type and carries the raw value. When passed through FFI, the raw value is used as-is (if llama.cpp supports it, the runtime will operate with that type). This variant preserves API compatibility when new ggml_type values are introduced in the future.

F32

F16

Q4_0

Q4_1

Q5_0

Q5_1

Q8_0

Q8_1

Q2_K

Q3_K

Q4_K

Q5_K

Q6_K

Q8_K

IQ2_XXS

IQ2_XS

IQ3_XXS

IQ1_S

IQ4_NL

IQ3_S

IQ2_S

IQ4_XS

I8

I16

I32

I64

F64

IQ1_M

BF16

TQ1_0

TQ2_0

MXFP4

Trait Implementations

impl Clone for KvCacheType

fn clone(&self) -> KvCacheType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvCacheType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<KvCacheType> for ggml_type

fn from(value: KvCacheType) -> Self

Converts to this type from the input type.

impl From<u32> for KvCacheType

fn from(value: ggml_type) -> Self

Converts to this type from the input type.

impl PartialEq for KvCacheType

fn eq(&self, other: &KvCacheType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for KvCacheType

impl Eq for KvCacheType

impl StructuralPartialEq for KvCacheType