Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(input: &str) -> Vec<Token<'_>>
Expand description

Tokenizes a Cypher query string into a list of tokens.

The tokens borrow input (ADR-0505): they stay valid exactly as long as the query text does.