Enum InferenceError 

#[non_exhaustive]
pub enum InferenceError {
    Oom,
    SequenceNotFound(u64),
    DoubleFree(PageId),
    PageOutOfBounds(PageId, usize),
    SlotOutOfRange {
        slot: usize,
        capacity: usize,
    },
    KvShapeMismatch {
        expected_heads: usize,
        expected_dim: usize,
        got_heads: usize,
        got_dim: usize,
    },
    MaxPagesExceeded(u64),
    Neural(NeuralError),
}

Errors specific to inference / paged KV cache operations.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Oom

No free pages remaining in the pool.

SequenceNotFound(u64)

The requested sequence ID is not tracked by the block manager.

DoubleFree(PageId)

A page was freed more than once.

PageOutOfBounds(PageId, usize)

Page ID is out of bounds for the pool.

SlotOutOfRange

Slot position exceeds page capacity.

Fields

slot: usize

Requested slot index.

capacity: usize

Page capacity (block_size).

KvShapeMismatch

Shape mismatch when writing key/value tensors.

Fields

expected_heads: usize

Expected number of heads.

expected_dim: usize

Expected head dimension.

got_heads: usize

Actual number of heads.

got_dim: usize

Actual head dimension.

MaxPagesExceeded(u64)

The sequence already has the maximum number of pages allocated.

Neural(NeuralError)

A neural layer error propagated from elsewhere in the crate.

Trait Implementations

impl Debug for InferenceError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for InferenceError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for InferenceError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<NeuralError> for InferenceError

fn from(source: NeuralError) -> Self

Converts to this type from the input type.