Struct moore::lexer::BufferedLexer

pub struct BufferedLexer<T> { /* fields omitted */ }

A buffered lexer that allows tokens to be peeked at before they are actually consumed.

Implementations

impl<T> BufferedLexer<T> where
    T: Clone + PartialEq<T>, 

pub fn new(
    inner: Box<dyn Lexer<T> + 'static, Global>,
    eof: T
) -> BufferedLexer<T>

Create a new buffered lexer.

pub fn peek<'td>(&mut self, offset: usize) -> Result<&T, DiagnosticBuilder<'td>>

Peek at a token not yet consumed. This function merely returns a reference to said token. Use pop() to advance the lexer.

pub fn push(&mut self, token: T)

Insert a token in front of the stream such that it becomes the next token to be returned from peek(0) or pop().

pub fn pop<'td>(&mut self) -> Result<T, DiagnosticBuilder<'td>>

Consume and return the current token. This is the same token that would be returned by peek(0).

pub fn inner(&self) -> &dyn Lexer<T>

pub fn inner_mut(&mut self) -> &mut dyn Lexer<T>