Enum syntaxdot_tokenizers::TokenizerError

pub enum TokenizerError {
    OpenError {
        model_path: String,
        inner: Error,
    },
    SentencePiece(SentencePieceError),
    WordPieces(WordPiecesError),
}

Variants

OpenError

Fields of OpenError

model_path: Stringinner: Error

SentencePiece(SentencePieceError)

WordPieces(WordPiecesError)

Implementations

impl TokenizerError

pub fn open_error(model_path: impl Into<String>, inner: Error) -> Self

Trait Implementations

impl Debug for TokenizerError

pub fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenizerError

pub fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for TokenizerError

pub fn source(&self) -> Option<&(dyn Error + 'static)>

The lower-level source of this error, if any.

pub fn backtrace(&self) -> Option<&Backtrace>

🔬 This is a nightly-only experimental API. (backtrace)

Returns a stack backtrace, if available, of where this error occurred.

pub fn description(&self) -> &str

👎 Deprecated since 1.42.0:

use the Display impl or to_string()

pub fn cause(&self) -> Option<&dyn Error>

👎 Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

impl From<SentencePieceError> for TokenizerError

pub fn from(source: SentencePieceError) -> Self

Performs the conversion.

impl From<WordPiecesError> for TokenizerError

pub fn from(source: WordPiecesError) -> Self

Performs the conversion.