Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(source: &str) -> Result<Vec<Token>, Diagnostic>
Expand description

Tokenize with default resource bounds.