Enum InferenceError

pub enum InferenceError {
    TokenizationFailed,
    ContextFull,
    EndOfText,
    UserCallback(Box<dyn Error>),
}

Errors encountered during the inference process.

Variants

TokenizationFailed

During tokenization, one of the produced tokens was invalid / zero.

ContextFull

The context window for the model is full.

EndOfText

The model has produced an end of text token, signalling that it thinks that the text should end here.

Note that this error can be ignored and inference can continue, but the results are not guaranteed to be sensical.

UserCallback(Box<dyn Error>)

The user-specified callback returned an error.

Trait Implementations

impl Debug for InferenceError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for InferenceError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for InferenceError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.