Enum finalfusion::vocab::VocabWrap

pub enum VocabWrap {
    SimpleVocab(SimpleVocab),
    ExplicitSubwordVocab(ExplicitSubwordVocab),
    FastTextSubwordVocab(FastTextSubwordVocab),
    FloretSubwordVocab(FloretSubwordVocab),
    BucketSubwordVocab(BucketSubwordVocab),
}

Vocabulary types wrapper.

This crate makes it possible to create fine-grained embedding types, such as Embeddings<SimpleVocab, NdArray> or Embeddings<SubwordVocab, QuantizedArray>. However, in some cases it is more pleasant to have a single type that covers all vocabulary and storage types. VocabWrap and StorageWrap wrap all the vocabularies and storage types known to this crate such that the type Embeddings<VocabWrap, StorageWrap> covers all variations.

Variants

SimpleVocab(SimpleVocab)

ExplicitSubwordVocab(ExplicitSubwordVocab)

FastTextSubwordVocab(FastTextSubwordVocab)

FloretSubwordVocab(FloretSubwordVocab)

BucketSubwordVocab(BucketSubwordVocab)

Trait Implementations

impl Clone for VocabWrap

fn clone(&self) -> VocabWrap

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VocabWrap

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<SimpleVocab> for VocabWrap

fn from(v: SimpleVocab) -> Self

Converts to this type from the input type.

impl From<SubwordVocab<ExplicitIndexer>> for VocabWrap

fn from(v: ExplicitSubwordVocab) -> Self

Converts to this type from the input type.

impl From<SubwordVocab<FastTextIndexer>> for VocabWrap

fn from(v: FastTextSubwordVocab) -> Self

Converts to this type from the input type.

impl From<SubwordVocab<FloretIndexer>> for VocabWrap

fn from(v: FloretSubwordVocab) -> Self

Converts to this type from the input type.

impl From<SubwordVocab<HashIndexer<FnvHasher>>> for VocabWrap

fn from(v: BucketSubwordVocab) -> Self

Converts to this type from the input type.

impl PartialEq for VocabWrap

fn eq(&self, other: &VocabWrap) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Vocab for VocabWrap

fn words_len(&self) -> usize

Get the vocabulary size.

fn words(&self) -> &[String]

Get the words in the vocabulary.

fn idx(&self, word: &str) -> Option<WordIndex>

Get the index of a token.

fn vocab_len(&self) -> usize

Get the total length of this vocabulary, including possible subword indices.

impl Eq for VocabWrap

impl StructuralEq for VocabWrap

impl StructuralPartialEq for VocabWrap