Struct TokenBuffer 

pub struct TokenBuffer { /* private fields */ }

A simple token buffer for look-ahead parsing.

Wraps a token stream and provides lookahead operations without consuming the underlying iterator.

Implementations

impl TokenBuffer

pub fn new(tokens: Vec<String>) -> Self

Create a token buffer from a list of token strings.

pub fn peek(&self) -> Option<&str>

Peek at the current token without consuming.

pub fn peek_at(&self, n: usize) -> Option<&str>

Peek n positions ahead (0 = current).

pub fn advance(&mut self) -> Option<&str>

Advance and return the consumed token.

pub fn eat(&mut self, expected: &str) -> bool

Consume the current token if it equals expected.

pub fn remaining(&self) -> usize

Return remaining token count.

pub fn is_eof(&self) -> bool

Check if at end of token stream.

pub fn mark(&self) -> usize

Mark the current position (for backtracking).

pub fn reset_to(&mut self, mark: usize)

Reset to a previously marked position.

Trait Implementations

impl Clone for TokenBuffer

fn clone(&self) -> TokenBuffer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenBuffer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.