Struct tongrams::DoubleArrayVocabulary

pub struct DoubleArrayVocabulary { /* private fields */ }

Compact double-array implementation of Vocabulary.

Trait Implementations

impl Debug for DoubleArrayVocabulary

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DoubleArrayVocabulary

fn default() -> DoubleArrayVocabulary

Returns the “default value” for a type.

impl Vocabulary for DoubleArrayVocabulary

fn new() -> Box<Self>

Creates an empty Vocabulary.

fn build(tokens: &[Gram<'_>]) -> Result<Box<Self>>

Builds a Vocabulary from a sequence of tokens.

fn serialize_into<W>(&self, writer: W) -> Result<usize> where
    W: Write, 

Serializes the data structure into the writer.

fn deserialize_from<R>(reader: R) -> Result<Box<Self>> where
    R: Read, 

Deserializes the data structure from the reader.

fn size_in_bytes(&self) -> usize

Gets the number of bytes to serialize the data structure.

fn memory_statistics(&self) -> Value

Gets breakdowns of memory usages for components.

fn get(&self, token: Gram<'_>) -> Option<usize>

Looks up a token.