Struct lrlex::LRNonStreamingLexer

pub struct LRNonStreamingLexer<'lexer, 'input: 'lexer, LexemeT, StorageT: Debug> { /* fields omitted */ }

An LRNonStreamingLexer holds a reference to a string and can lex it into lrpar::Lexemes. Although the struct is tied to a single string, no guarantees are made about whether the lexemes are cached or not.

Implementations

impl<'lexer, 'input: 'lexer, LexemeT: Lexeme<StorageT>, StorageT: Copy + Eq + Debug + Hash + PrimInt + TryFrom<usize> + Unsigned> LRNonStreamingLexer<'lexer, 'input, LexemeT, StorageT>

pub fn new(
    s: &'input str,
    lexemes: Vec<Result<LexemeT, LexError>>,
    newlines: Vec<usize>
) -> LRNonStreamingLexer<'lexer, 'input, LexemeT, StorageT>

Create a new LRNonStreamingLexer that read in: the input s; and derived lexemes and newlines. The newlines Vec<usize> is a sorted list of the byte index of the start of the following line. i.e. for the input string " a\nb\n c d" the Vec should contain [3, 5].

Note that if one or more lexemes or newlines was not created from s, subsequent calls to the LRNonStreamingLexer may cause panics.

Trait Implementations

impl<'lexer, 'input: 'lexer, LexemeT: Lexeme<StorageT>, StorageT: Copy + Debug + Eq + Hash + PrimInt + Unsigned> Lexer<LexemeT, StorageT> for LRNonStreamingLexer<'lexer, 'input, LexemeT, StorageT>

fn iter<'a>(
    &'a self
) -> Box<dyn Iterator<Item = Result<LexemeT, LexError>> + 'a>

Iterate over all the lexemes in this lexer. Note that:

impl<'lexer, 'input: 'lexer, LexemeT: Lexeme<StorageT>, StorageT: Copy + Eq + Debug + Hash + PrimInt + Unsigned> NonStreamingLexer<'input, LexemeT, StorageT> for LRNonStreamingLexer<'lexer, 'input, LexemeT, StorageT>

fn span_str(&self, span: Span) -> &'input str

Return the user input associated with a Span.

fn span_lines_str(&self, span: Span) -> &'input str

Return the lines containing the input at span (including all the text on the lines that span starts and ends on).

fn line_col(&self, span: Span) -> ((usize, usize), (usize, usize))

Return ((start line, start column), (end line, end column)) for span. Note that column characters (not bytes) are returned.