pub fn tokenize(input: &str) -> Result<Vec<Token>, ParseError>Expand description
Tokenize a PDDL source string into a flat vector of Tokens.
Line comments (starting with ;) are stripped. All symbols, keywords, and
variables are lowercased so that later comparisons are case-insensitive.
§Arguments
input- The raw PDDL source text to tokenize
§Returns
A vector of tokens in order of appearance.
§Errors
Returns ParseError if the input contains an unexpected character or
a malformed numeric literal.