Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

Lexer for LNMP text format

Implementations

impl<'a> Lexer<'a>

pub fn new(input: &'a str) -> Self

Creates a new lexer for the given input

pub fn new_owned(input: String) -> Self

Creates a new lexer owning its input (used after sanitization)

pub fn new_owned_with_original( sanitized: String, original: String, span_map: SpanMap, ) -> Self

Creates a new lexer owning sanitized input and carrying original for span mapping.

pub fn position(&self) -> (usize, usize)

Returns the current position (line, column)

pub fn position_original(&self) -> (usize, usize)

Returns position mapped to original input if available (lenient mode).

impl<'a> Lexer<'a>

pub fn next_token(&mut self) -> Result<Token, LnmpError>

Reads the next token from the input