pub struct TokenizerError { /* private fields */ }Expand description
An error produced while building, encoding with, or decoding a tokenizer.
Implementations§
Source§impl TokenizerError
impl TokenizerError
Sourcepub fn is_incomplete_utf8(&self) -> bool
pub fn is_incomplete_utf8(&self) -> bool
Returns true when decoding ended with a potentially completable UTF-8
byte sequence.
Trait Implementations§
Source§impl Clone for TokenizerError
impl Clone for TokenizerError
Source§impl Debug for TokenizerError
impl Debug for TokenizerError
Source§impl Display for TokenizerError
impl Display for TokenizerError
impl Eq for TokenizerError
Source§impl Error for TokenizerError
impl Error for TokenizerError
1.30.0 · Source§fn source(&self) -> Option<&(dyn Error + 'static)>
fn source(&self) -> Option<&(dyn Error + 'static)>
Returns the lower-level source of this error, if any. Read more
1.0.0 · Source§fn description(&self) -> &str
fn description(&self) -> &str
👎Deprecated since 1.42.0:
use the Display impl or to_string()
Source§impl From<GgufError> for TokenizerError
impl From<GgufError> for TokenizerError
Source§impl PartialEq for TokenizerError
impl PartialEq for TokenizerError
impl StructuralPartialEq for TokenizerError
Auto Trait Implementations§
impl Forget for TokenizerError
impl Freeze for TokenizerError
impl Move for TokenizerError
impl RefUnwindSafe for TokenizerError
impl Send for TokenizerError
impl Sync for TokenizerError
impl Unpin for TokenizerError
impl UnsafeUnpin for TokenizerError
impl UnwindSafe for TokenizerError
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more