Function lamcal::parser::tokenize_str[][src]

pub fn tokenize_str(
    input: &str
) -> Result<Vec<(Token, CharPosition)>, ParseError>

Converts a str slice into a list of Tokens.

This is a wrapper function that calls the more general tokenize function by converting the input str slice into an Iterator over its chars.