Enum rust2vec::vocab::VocabWrap

pub enum VocabWrap {
    SimpleVocab(SimpleVocab),
    SubwordVocab(SubwordVocab),
}

Vocabulary types wrapper.

This crate makes it possible to create fine-grained embedding types, such as Embeddings<SimpleVocab, NdArray> or Embeddings<SubwordVocab, QuantizedArray>. However, in some cases it is more pleasant to have a single type that covers all vocabulary and storage types. VocabWrap and StorageWrap wrap all the vocabularies and storage types known to this crate such that the type Embeddings<VocabWrap, StorageWrap> covers all variations.

Variants

SimpleVocab(SimpleVocab)SubwordVocab(SubwordVocab)

Trait Implementations

impl Vocab for VocabWrap

fn idx(&self, word: &str) -> Option<WordIndex>

Get the index of a token.

fn len(&self) -> usize

Get the vocabulary size.

fn words(&self) -> &[String]

Get the words in the vocabulary.

impl From<SimpleVocab> for VocabWrap

fn from(v: SimpleVocab) -> Self

Performs the conversion.

impl From<SubwordVocab> for VocabWrap

fn from(v: SubwordVocab) -> Self

Performs the conversion.

impl Clone for VocabWrap

fn clone(&self) -> VocabWrap

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VocabWrap

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.