Struct sqlite3_parser::lexer::Scanner

pub struct Scanner<S: Splitter> { /* private fields */ }

Like a BufReader but with a growable buffer. Successive calls to the scan method will step through the ‘tokens’ of a file, skipping the bytes between the tokens.

Scanning stops unrecoverably at EOF, the first I/O error, or a token too large to fit in the buffer. When a scan stops, the reader may have advanced arbitrarily far past the last token.

Implementations

impl<S: Splitter> Scanner<S>

pub fn new(splitter: S) -> Scanner<S>

pub fn line(&self) -> u64

Current line number

pub fn column(&self) -> usize

Current column number (byte offset, not char offset)

pub fn splitter(&self) -> &S

pub fn mark(&mut self)

pub fn reset_to_mark(&mut self)

pub fn reset(&mut self)

Reset the scanner such that it behaves as if it had never been used.

impl<S: Splitter> Scanner<S>

pub fn scan<'input>( &mut self, input: &'input [u8] ) -> Result<(usize, Option<(&'input [u8], S::TokenType)>, usize), S::Error>

Advance the Scanner to next token. Return the token as a byte slice. Return None when the end of the input is reached. Return any error that occurs while reading the input.

Trait Implementations

impl<S: Splitter> Debug for Scanner<S>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.