tokenize_bytes

Function tokenize_bytes 

Source
pub fn tokenize_bytes(bytes: &[u8]) -> Result<Tokens<'_>, TokenizationError>
Expand description

Like tokenize_str but for bytes