Enum KvCacheError 

pub enum KvCacheError {
    LayerOutOfBounds {
        layer: usize,
        num_layers: usize,
    },
    CacheFull {
        max_seq_len: usize,
    },
    ShapeMismatch {
        expected: Vec<usize>,
        got: Vec<usize>,
    },
}

Error for ndarray-based KV-cache operations.

Variants

LayerOutOfBounds

Layer index is out of bounds.

Fields

layer: usize

num_layers: usize

CacheFull

Cache has reached maximum sequence length.

Fields

max_seq_len: usize

ShapeMismatch

Tensor shape does not match expected shape.

Fields

expected: Vec<usize>

got: Vec<usize>

Trait Implementations

impl Clone for KvCacheError

fn clone(&self) -> KvCacheError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvCacheError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for KvCacheError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for KvCacheError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<KvCacheError> for CachedAttentionError

fn from(e: KvCacheError) -> Self

Converts to this type from the input type.