Trait Lexer

pub trait Lexer<'a> {
    type Token: Eq;
    type Position: Clone + Hash + Eq + PartialOrd;

    // Required methods
    fn new(input: &'a str) -> Self;
    fn lexeme(&self) -> &str;
    fn span(&self) -> Span;
    fn pos(&self) -> &Self::Position;
    fn next(&mut self) -> Option<Self::Token>;
    fn is_empty(&self) -> bool;
    fn advance_to_pos(&mut self, pos: &Self::Position);
    fn fork(&self) -> Self;
}

A lexer for the parser.

Required Associated Types

type Token: Eq

The lexed token type.

type Position: Clone + Hash + Eq + PartialOrd

The lexeme type.

Required Methods

fn new(input: &'a str) -> Self

Create a new lexer from the given input.

fn lexeme(&self) -> &str

Get the current lexeme.

fn span(&self) -> Span

Get the current span.

fn pos(&self) -> &Self::Position

Get the current position.

fn next(&mut self) -> Option<Self::Token>

Consume the next token.

fn is_empty(&self) -> bool

Whether the lexer is at the end of the input.

fn advance_to_pos(&mut self, pos: &Self::Position)

Advance the lexer to the given lexeme.

fn fork(&self) -> Self

Fork the lexer.

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors

impl<'a> Lexer<'a> for CharLexer<'a>

type Token = char

type Position = usize