Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

The scanner. It holds the source and a cursor and nothing else.

Implementations

impl<'a> Lexer<'a>

pub fn new(source: &'a [u8]) -> Lexer<'a>

Returns a lexer positioned at the start of the source.

pub fn at(source: &'a [u8], offset: usize) -> Lexer<'a>

Returns a lexer positioned at a byte offset in the source.

pub fn offset(&self) -> usize

Returns the current byte offset.

pub fn source(&self) -> &'a [u8]

Returns the source being scanned.

pub fn next_token(&mut self) -> Result<Token, LexError>

Scans and returns the next token, skipping trivia first.

Trait Implementations

impl<'a> Clone for Lexer<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.