Module sqlite3_parser::lexer
source · Expand description
Streaming SQLite tokenizer
Modules
Adaptation/port of
SQLite tokenizerStructs
Streaming input
Like a
BufReader but with a growable buffer.
Successive calls to the scan method will step through the ‘tokens’
of a file, skipping the bytes between the tokens.