[−][src]Struct finalfrontier::SubwordVocabConfig
Hyperparameters for subword-vocabs.
Fields
min_n: u32
Minimum n-gram length for subword units (inclusive).
max_n: u32
Maximum n-gram length for subword units (inclusive).
buckets_exp: u32
Bucket exponent. The model will use 2^bucket_exp buckets.
A typical value for this parameter is 21, which gives roughly 2M buckets.
min_count: u32
Minimum token count.
No word-specific embeddings will be trained for tokens occurring less than this count.
discard_threshold: f32
Discard threshold.
The discard threshold is used to compute the discard probability of a token. E.g. with a threshold of 0.00001 tokens with approximately that probability will never be discarded.
Trait Implementations
impl Clone for SubwordVocabConfig
[src]
fn clone(&self) -> SubwordVocabConfig
[src]
fn clone_from(&mut self, source: &Self)
1.0.0[src]
impl Copy for SubwordVocabConfig
[src]
impl Debug for SubwordVocabConfig
[src]
impl Serialize for SubwordVocabConfig
[src]
Auto Trait Implementations
impl Send for SubwordVocabConfig
impl Sync for SubwordVocabConfig
impl Unpin for SubwordVocabConfig
impl UnwindSafe for SubwordVocabConfig
impl RefUnwindSafe for SubwordVocabConfig
Blanket Implementations
impl<T, U> Into<U> for T where
U: From<T>,
[src]
U: From<T>,
impl<T> From<T> for T
[src]
impl<T> ToOwned for T where
T: Clone,
[src]
T: Clone,
type Owned = T
The resulting type after obtaining ownership.
fn to_owned(&self) -> T
[src]
fn clone_into(&self, target: &mut T)
[src]
impl<T, U> TryFrom<U> for T where
U: Into<T>,
[src]
U: Into<T>,
type Error = Infallible
The type returned in the event of a conversion error.
fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>
[src]
impl<T, U> TryInto<U> for T where
U: TryFrom<T>,
[src]
U: TryFrom<T>,
type Error = <U as TryFrom<T>>::Error
The type returned in the event of a conversion error.
fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>
[src]
impl<T> Borrow<T> for T where
T: ?Sized,
[src]
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
[src]
T: ?Sized,
fn borrow_mut(&mut self) -> &mut T
[src]
impl<T> Any for T where
T: 'static + ?Sized,
[src]
T: 'static + ?Sized,