Struct Vocabulary 

pub struct Vocabulary { /* private fields */ }

Shared vocabulary learnt from a corpus. Incremental — new tokens allocate a fresh index on add.

Implementations

impl Vocabulary

pub fn new() -> Vocabulary

pub fn add_document(&mut self, tokens: &[&str])

Register a document — increments document frequency for each distinct token observed.

pub fn dimensions(&self) -> usize

pub fn index_of(&self, token: &str) -> Option<usize>

Trait Implementations

impl Clone for Vocabulary

fn clone(&self) -> Vocabulary

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Vocabulary

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for Vocabulary

fn default() -> Vocabulary

Returns the “default value” for a type.