Enum NativeTokenizerError 

pub enum NativeTokenizerError {
    Tokenizer(TokenizerError),
    NoChatTemplate,
    EncodeFailed(String),
}

Errors that can arise from NativeTokenizerBridge operations.

Variants

Tokenizer(TokenizerError)

Wraps an error propagated from the underlying OxiTokenizer.

NoChatTemplate

Returned when NativeTokenizerBridge::format_chat is called but no chat template was configured at construction time.

EncodeFailed(String)

Encoding failed for a reason not covered by the underlying tokenizer error type (e.g. an internal invariant violation).

Trait Implementations

impl Debug for NativeTokenizerError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for NativeTokenizerError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for NativeTokenizerError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0:

use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0:

replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl From<TokenizerError> for NativeTokenizerError

fn from(source: TokenizerError) -> Self

Converts to this type from the input type.