Expand description

Streaming SQLite tokenizer

Modules

Adaptation/port of SQLite tokenizer

Structs

Streaming input

Like a BufReader but with a growable buffer. Successive calls to the scan method will step through the ‘tokens’ of a file, skipping the bytes between the tokens.

Traits

Split function used to tokenize the input