pub trait Tokens {
// Required methods
fn tokens(&self) -> TokenIter<'_> ⓘ;
fn tokens_mut(&mut self) -> TokenIterMut<'_> ⓘ;
}
Expand description
Get tokens of a sentence.
Required Methods§
Sourcefn tokens_mut(&mut self) -> TokenIterMut<'_> ⓘ
fn tokens_mut(&mut self) -> TokenIterMut<'_> ⓘ
Get the tokens in a sentence mutably.