Function geo_aid::script::token::tokenize

pub fn tokenize(input: &str) -> Result<Vec<Token>, Error>

Tokenizes the given script.

Errors

Emits an appropriate error if the script is invalid and tokenization fails.