Struct AugmentationDetectLanguage

pub struct AugmentationDetectLanguage { /* private fields */ }

Will run language and script detection using whatlang.

This is recommended to be run on whole sentences before splitting them into words.

It is unlikely to yield desireable results on the word level as words are usually valid in more than one language.

Implementations

impl AugmentationDetectLanguage

pub fn new() -> Self

Create a new AugmentationDetectLanguage instance.

pub fn new_with_detector(detector: Detector) -> Self

Create a new AugmentationDetectLanguage instance with a custom whatlang Detector.

Trait Implementations

impl Augmenter for AugmentationDetectLanguage

fn augment<'a>(&self, token: SegmentedToken<'a>) -> SegmentedToken<'a>

Apply augmentation function to the given token and return it.

impl Clone for AugmentationDetectLanguage

fn clone(&self) -> AugmentationDetectLanguage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AugmentationDetectLanguage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AugmentationDetectLanguage

fn default() -> AugmentationDetectLanguage

Returns the “default value” for a type.