pub enum TokenizerModel {
Llama,
Other(String),
}Expand description
The tokenizer model name declared by GGUF metadata.
Variants§
Llama
The llama tokenizer model.
Other(String)
Any tokenizer model identifier that Ferrite does not classify specially.
Trait Implementations§
Source§impl Clone for TokenizerModel
impl Clone for TokenizerModel
Source§impl Debug for TokenizerModel
impl Debug for TokenizerModel
impl Eq for TokenizerModel
Source§impl PartialEq for TokenizerModel
impl PartialEq for TokenizerModel
impl StructuralPartialEq for TokenizerModel
Auto Trait Implementations§
impl Forget for TokenizerModel
impl Freeze for TokenizerModel
impl Move for TokenizerModel
impl RefUnwindSafe for TokenizerModel
impl Send for TokenizerModel
impl Sync for TokenizerModel
impl Unpin for TokenizerModel
impl UnsafeUnpin for TokenizerModel
impl UnwindSafe for TokenizerModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more