Struct Lexer

pub struct Lexer<'a> { /* private fields */ }

The lexer to convert source code into tokens representing the source code.

Implementations

impl<'a> Lexer<'a>

pub fn new(input: &'a str) -> Self

Create a new lexer over the given input string.

This will initialize the internal state and read the first character, so the lexer is ready to produce tokens via next_token().

pub fn next_token(&mut self) -> Token

Determine and return the next token in the input from the current character position.

Trait Implementations

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.