Function tokenize_str

Source
pub fn tokenize_str(text: &str) -> Result<Tokens<'_>, TokenizationError>
Expand description

Turn str into Tokens.

Usually not used directly.