Struct BertOptions 

pub struct BertOptions {
    pub lowercase: bool,
    pub strip_accents: bool,
}

Configuration for a Bert normalizer.

Fields

lowercase: bool

If true, convert all text to lowercase using char::to_lowercase.

strip_accents: bool

Whether to strip accents when tokenizing. An “accent” is defined as any unicode character in the Nonspacing Mark (“Mn”) category.

Trait Implementations

impl Clone for BertOptions

fn clone(&self) -> BertOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BertOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BertOptions

fn default() -> BertOptions

Returns the “default value” for a type.