Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(source: &str) -> Vec<Token>
Expand description

Tokenizes a complete shell script. The stream always ends with an EOF token.