Enum InferenceError 

pub enum InferenceError {
    InvalidConfig {
        reason: String,
    },
    Failed {
        reason: String,
    },
    InvalidSampling {
        reason: String,
    },
    CacheFull {
        position: usize,
        max_len: usize,
    },
    SamplingError {
        reason: String,
    },
    EndOfSequence {
        position: usize,
    },
}

Errors related to inference operations.

Variants

InvalidConfig

Invalid generation configuration

Fields

reason: String

Description of the configuration issue

Failed

Generation failed

Fields

reason: String

Description of the failure

InvalidSampling

Invalid sampling parameters

Fields

reason: String

Description of the sampling issue

CacheFull

KV-cache is full

Fields

position: usize

Current cache position

max_len: usize

Maximum cache length

SamplingError

Token sampling failed

Fields

reason: String

Description of the sampling error

EndOfSequence

End-of-sequence reached

Fields

position: usize

Position where EOS was reached

Trait Implementations

impl Debug for InferenceError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for InferenceError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for InferenceError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<InferenceError> for Error

fn from(source: InferenceError) -> Self

Converts to this type from the input type.