Struct finalfrontier::SimpleVocabConfig

pub struct SimpleVocabConfig {
    pub min_count: u32,
    pub discard_threshold: f32,
}

Hyperparameters for simple vocabs.

Fields

min_count: u32

Minimum token count.

No word-specific embeddings will be trained for tokens occurring less than this count.

discard_threshold: f32

Discard threshold.

The discard threshold is used to compute the discard probability of a token. E.g. with a threshold of 0.00001 tokens with approximately that probability will never be discarded.

Trait Implementations

impl Copy for SimpleVocabConfig

impl Clone for SimpleVocabConfig

fn clone(&self) -> SimpleVocabConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SimpleVocabConfig

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl Serialize for SimpleVocabConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error> where
    __S: Serializer, 

Serialize this value into the given Serde serializer.