Struct Lexer 

pub struct Lexer<'a> {
    pub pos: usize,
    /* private fields */
}

The lexer struct, which produces tokens from an input string.

Fields

pos: usize

Implementations

impl<'a> Lexer<'a>

pub fn new(input: &'a str) -> Self

pub fn peek_token(&self) -> Option<Token>

Peek at the next token without consuming it

pub fn get_remaining_input(&self) -> Option<&str>

Get the remaining input from the current position

pub fn get_original_input(&self) -> &'a str

Get the original input string

pub fn next_token(&mut self) -> Option<Token>

Get the next token from the input.

Trait Implementations

impl<'a> Clone for Lexer<'a>

fn clone(&self) -> Lexer<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.