Enum TokenizerError 

pub enum TokenizerError {
    ModelLoadError(String),
    HashMismatch {
        expected: String,
        actual: String,
    },
    UnsupportedModel(String),
}

Errors that can occur when creating or using the tokenizer.

Variants

ModelLoadError(String)

The SentencePiece model failed to load.

HashMismatch

The embedded model’s hash does not match the expected value.

Fields

expected: String

actual: String

UnsupportedModel(String)

The requested model name is not supported.

Trait Implementations

impl Debug for TokenizerError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenizerError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for TokenizerError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.