Enum NormalizedText 

pub enum NormalizedText {
    NotNormalized,
    NormalizedToSelf,
    Normalized(String),
}

Represents the outcomes of text normalization that can happen on a SegmentedToken.

Variants

NotNormalized

The token was not normalized, either it didn’T pass a normalization stage, or the normlaization stage didn’t attempt normlaization (i.e. because no algorithm is implemented for a specific language)

NormalizedToSelf

The token was normalized, but the result is the same as the original text

Normalized(String)

The token was normalized into something that is not the original text.

Trait Implementations

impl Clone for NormalizedText

fn clone(&self) -> NormalizedText

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for NormalizedText

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for NormalizedText

fn default() -> NormalizedText

Returns the “default value” for a type.

impl From<NormalizedText> for Option<String>

fn from(value: NormalizedText) -> Self

Converts to this type from the input type.

impl PartialEq for NormalizedText

fn eq(&self, other: &NormalizedText) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for NormalizedText

impl StructuralPartialEq for NormalizedText