Struct moore_common::lexer::BufferedLexer

pub struct BufferedLexer<T> { /* private fields */ }

A buffered lexer that allows tokens to be peeked at before they are actually consumed.

Implementations

impl<T: Clone + PartialEq> BufferedLexer<T>

pub fn new(inner: Box<dyn Lexer<T>>, eof: T) -> BufferedLexer<T>

Create a new buffered lexer.

pub fn peek<'td>(&mut self, offset: usize) -> DiagResult<'td, &T>

Peek at a token not yet consumed. This function merely returns a reference to said token. Use pop() to advance the lexer.

pub fn push(&mut self, token: T)

Insert a token in front of the stream such that it becomes the next token to be returned from peek(0) or pop().

pub fn pop<'td>(&mut self) -> DiagResult<'td, T>

Consume and return the current token. This is the same token that would be returned by peek(0).

pub fn inner(&self) -> &dyn Lexer<T>

pub fn inner_mut(&mut self) -> &mut dyn Lexer<T>