pub struct VocabFingerprint(/* private fields */);Expand description
A content address of a vocabulary’s token map. Equal fingerprints denote the same token->bytes relation, so they share a byte-trie.
Implementations§
Source§impl VocabFingerprint
impl VocabFingerprint
Sourcepub fn of(vocab: &Vocabulary) -> Result<Self, CompileError>
pub fn of(vocab: &Vocabulary) -> Result<Self, CompileError>
Computes the fingerprint from the token map SORTED by bytes then id (never the HashMap’s
iteration order) plus the EOS id. Every variable-length field is length-prefixed - the byte
Trait Implementations§
Source§impl Clone for VocabFingerprint
impl Clone for VocabFingerprint
impl Copy for VocabFingerprint
Source§impl Debug for VocabFingerprint
impl Debug for VocabFingerprint
impl Eq for VocabFingerprint
Source§impl Hash for VocabFingerprint
impl Hash for VocabFingerprint
Source§impl PartialEq for VocabFingerprint
impl PartialEq for VocabFingerprint
impl StructuralPartialEq for VocabFingerprint
Auto Trait Implementations§
impl Freeze for VocabFingerprint
impl RefUnwindSafe for VocabFingerprint
impl Send for VocabFingerprint
impl Sync for VocabFingerprint
impl Unpin for VocabFingerprint
impl UnsafeUnpin for VocabFingerprint
impl UnwindSafe for VocabFingerprint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more