Enum KvCacheAppendError 

pub enum KvCacheAppendError {
    EmptyShape,
    Range {
        offset: u32,
        chunk_len: u32,
        capacity: u32,
    },
    ElementCountOverflow,
    UnsupportedDtype {
        dtype: DataType,
    },
}

Invalid cache append dimensions.

Variants

EmptyShape

A required dimension is zero.

Range

The appended chunk exceeds the cache generation.

Fields

offset: u32

First cache token replaced by the chunk.

chunk_len: u32

Logical chunk token count.

capacity: u32

Cache token capacity.

ElementCountOverflow

Flattened element counts exceeded addressable IR indexing.

UnsupportedDtype

The cache dtype cannot represent floating attention activations.

Fields

dtype: DataType

Rejected cache element dtype.

Trait Implementations

impl Clone for KvCacheAppendError

fn clone(&self) -> KvCacheAppendError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvCacheAppendError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for KvCacheAppendError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for KvCacheAppendError

impl Error for KvCacheAppendError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl PartialEq for KvCacheAppendError

fn eq(&self, other: &KvCacheAppendError) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for KvCacheAppendError