Struct boa::syntax::lexer::Lexer

pub struct Lexer<'a> {
    pub tokens: Vec<Token>,
    // some fields omitted
}

A lexical analyzer for JavaScript source code.

Fields

tokens: Vec<Token>

The list of tokens generated so far.

This field is public so you can use them once lexing has finished.

Implementations

impl<'a> Lexer<'a>

pub fn new(buffer: &'a str) -> Lexer<'a>

Returns a Lexer with a buffer inside

The buffer needs to have a lifetime as long as the Lexer instance itself

pub fn lex(&mut self) -> Result<(), LexerError>

Runs the lexer until completion, returning a LexerError if there's a syntax issue, or an empty unit result

Example

fn main() -> Result<(), LexerError> {
    let buffer = String::from("Hello World");
    let mut lexer = Lexer::new(&buffer);
    lexer.lex()
}

Trait Implementations

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.