Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

A tokenizer over a byte buffer.

Implementations

impl<'a> Lexer<'a>

pub fn new(buf: &'a [u8]) -> Self

A lexer at the start of buf.

pub fn buffer(&self) -> &'a [u8]

The whole buffer.

pub fn pos(&self) -> usize

Current position in the buffer.

pub fn set_pos(&mut self, pos: usize)

Moves to pos (clamped to the buffer’s end).

pub fn at_end(&self) -> bool

Whether the end of the buffer is reached.

pub fn rest(&self) -> &'a [u8]

The bytes from the current position on.

pub fn peek(&self) -> Option<u8>

The next byte, without consuming it.

pub fn skip_whitespace(&mut self)

Skips whitespace and comments.

pub fn next_token(&mut self) -> Result<Token<'a>>

Reads the next token.

Trait Implementations

impl<'a> Clone for Lexer<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.