Struct boa_parser::lexer::Lexer

pub struct Lexer<R> { /* private fields */ }

Lexer or tokenizer for the Boa JavaScript Engine.

Implementations

impl<R> Lexer<R>

pub fn new(reader: R) -> Self

where R: ReadChar,

Creates a new lexer.

pub fn next(&mut self, interner: &mut Interner) -> Result<Option<Token>, Error>

where R: ReadChar,

Retrieves the next token from the lexer, skipping comments.

Errors

Will return Err on invalid tokens and invalid reads of the bytes being lexed.

Trait Implementations

impl<R: Debug> Debug for Lexer<R>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> From<&'a [u8]> for Lexer<UTF8Input<&'a [u8]>>

fn from(input: &'a [u8]) -> Self

Converts to this type from the input type.