Struct nlprule::tokenizer::tag::Tagger

pub struct Tagger { /* fields omitted */ }

The lexical tagger.

Implementations

impl Tagger

pub fn id_tag<'a>(&self, tag: &'a str) -> PosId<'a>

Tags the given string representation of a part-of-speech tag. Part-of-speech tags are treated as a closed set so each valid part-of-speech tag will get a numerical id.

pub fn id_word<'a>(&self, text: Cow<'a, str>) -> WordId<'a>

Tags the given text. Unknown words will not get a numerical id.

pub fn get_tags_with_options(
    &self,
    word: &str,
    add_lower: Option<bool>,
    use_compound_split_heuristic: Option<bool>
) -> Vec<WordData<'_>>

Get the tags and lemmas (as WordData) for the given word.

Arguments

• word: The word to lookup data for.
• add_lower: Whether to add data for the lowercase variant of the word. If None, will be set according to the language options.
• use_compound_split_heuristic: Whether to use a heuristic to split compound words. If None, will be set according to the language options. If true, will attempt to find tags for words which are longer than some cutoff and unknown by looking up tags for substrings from left to right until tags are found or a minimum length reached.

pub fn get_tags(&self, word: &str) -> Vec<WordData<'_>>

Get the tags and lemmas (as WordData) for the given word using the default options of the tagger.

Arguments

• word: The word to lookup data for.

pub fn get_group_members(&self, lemma: &str) -> Vec<&str>

Get the words with the same lemma as the given lemma.

Trait Implementations

impl Clone for Tagger

fn clone(&self) -> Tagger

Returns a copy of the value.

pub fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for Tagger

fn default() -> Tagger

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for Tagger

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
    __D: Deserializer<'de>, 

Deserialize this value from the given Serde deserializer.

impl Serialize for Tagger

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error> where
    __S: Serializer, 

Serialize this value into the given Serde serializer.