Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

Lexes NWScript source using the upstream compiler’s token vocabulary.

Implementations

impl<'a> Lexer<'a>

pub fn new(source_id: SourceId, input: &'a [u8]) -> Self

Creates a lexer for one source file’s contents.

pub fn lex_all(&mut self) -> Result<Vec<Token>, LexerError>

Lexes the entire input into a token vector ending with Eof.

Errors

Returns LexerError if an unrecognized token is encountered.

Trait Implementations

impl<'a> Clone for Lexer<'a>

fn clone(&self) -> Lexer<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.