Function tokenize_str 

pub fn tokenize_str(input: &str) -> Result<Vec<Token>, TokenizerError>

Break the given input shell script string into tokens, returning the tokens.

Arguments

• input - The shell script to tokenize.