Trait Tokens

Source
pub trait Tokens {
    // Required methods
    fn tokens(&self) -> TokenIter<'_> ;
    fn tokens_mut(&mut self) -> TokenIterMut<'_> ;
}
Expand description

Get tokens of a sentence.

Required Methods§

Source

fn tokens(&self) -> TokenIter<'_>

Get an iterator over the tokens in a sentence.

Source

fn tokens_mut(&mut self) -> TokenIterMut<'_>

Get the tokens in a sentence mutably.

Implementors§