tokenize

Function tokenize 

Source
pub fn tokenize(input: &str) -> Vec<Token<'_>>
Expand description

Parse a string representing an ExprTK Expression Column into Tokens. A token list is sufficient for syntax-highlighting purposes, faster than a full parser and much easier to write a renderer for.