Struct Lexer 

pub struct Lexer { /* private fields */ }

Implementations

impl Lexer

pub fn new(input: &str, source_type: &SourceType) -> Self

pub fn peek(&mut self) -> Result<&Token, Error>

pub fn peek_second(&mut self) -> Result<&Token, Error>

pub fn next_token(&mut self) -> Result<Token, Error>

pub fn next_logical_name(&mut self) -> Result<Token, Error>

Opaque spec / repo / registry name for name positions only.

If a normal peek already materialized a prefix token, rewind and rescan so connectors (/, ., -) are absorbed into one TokenKind::LogicalName.

pub fn checkpoint(&self) -> LexerCheckpoint

Saved lexer position for speculative parsing.

pub fn restore(&mut self, checkpoint: LexerCheckpoint)

Trait Implementations

impl Clone for Lexer

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.