Struct Lexer 

pub struct Lexer {
    pub source: Vec<String>,
    /* private fields */
}

An object which translates a Magpie source string into a linear sequence of tokens.

Fields

source: Vec<String>

Implementations

impl Lexer

pub fn new() -> Self

pub fn add_text(&mut self, text: String) -> &mut Self

pub fn parse(&mut self) -> Vec<Token>

Convert the source string into a linear collection of tokens.

pub fn get_literal_string( &self, start_pos: usize, end_pos: usize, ) -> Option<String>

Get the string value of a literal from the source based on its start and end positions.