Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(input: &str) -> Vec<String>
Expand description

Tokenize splits an FCP operation string into tokens, handling quoted strings, escape sequences, and embedded newlines.