Module lexer

Source
Expand description

Streaming SQLite tokenizer

Modules§

sql
Adaptation/port of SQLite tokenizer

Structs§

Scanner
Like a BufReader but with a growable buffer. Successive calls to the scan method will step through the ‘tokens’ of a file, skipping the bytes between the tokens.

Traits§

ScanError
Error with position
Splitter
Split function used to tokenize the input