uncached_tokenize_str

Function uncached_tokenize_str 

Source
pub fn uncached_tokenize_str(
    input: &str,
    options: &TokenizerOptions,
) -> Result<Vec<Token>, TokenizerError>
Expand description

Break the given input shell script string into tokens, returning the tokens. No caching is performed.

ยงArguments

  • input - The shell script to tokenize.