Enum hime_redist::lexers::impls::Lexer

pub enum Lexer<'s, 't, 'a> {
    ContextFree(ContextFreeLexer<'s, 't, 'a>),
    ContextSensitive(ContextSensitiveLexer<'s, 't, 'a>),
}

Represents a lexer

Variants

ContextFree(ContextFreeLexer<'s, 't, 'a>)

A context-free lexer

ContextSensitive(ContextSensitiveLexer<'s, 't, 'a>)

A context-sensitive lexer

Implementations

impl<'s, 't, 'a> Lexer<'s, 't, 'a>

pub fn get_data(&self) -> &LexerData<'s, 't, 'a>

Gets the data for the lexer

pub fn get_data_mut(&mut self) -> &mut LexerData<'s, 't, 'a>

Gets the data for the lexer

pub fn get_next_token( &mut self, contexts: &dyn ContextProvider ) -> Option<TokenKernel>

Gets the next token in the input