Enum BytePairEncoderError

pub enum BytePairEncoderError {
    InvalidFile(String),
    InvalidVocabularyInput,
    DecompressionError(String),
    DeserializationError(String),
    NoDefaultVocabFeature,
}

Represents errors that can occur during BPE tokenization operations.

Variants

InvalidFile(String)

Indicates an error occurred while reading the vocabulary file.

InvalidVocabularyInput

Indicates that the vocabulary input was invalid or could not be parsed correctly.

DecompressionError(String)

Indicates an error occurred during decompression of the vocabulary data.

DeserializationError(String)

Indicates an error occurred during deserialization of the vocabulary data.

NoDefaultVocabFeature

Trait Implementations

impl Clone for BytePairEncoderError

fn clone(&self) -> BytePairEncoderError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BytePairEncoderError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for BytePairEncoderError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for BytePairEncoderError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl PartialEq for BytePairEncoderError

fn eq(&self, other: &BytePairEncoderError) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for BytePairEncoderError

impl StructuralPartialEq for BytePairEncoderError