Module lexer

Streaming SQLite tokenizer

Modules

sql

Adaptation/port of SQLite tokenizer

Structs

Scanner

Like a BufReader but with a growable buffer. Successive calls to the scan method will step through the ‘tokens’ of a file, skipping the bytes between the tokens.

Traits

ScanError

Error with position

Splitter

Split function used to tokenize the input