Struct Lexer

pub struct Lexer;

Implementations

impl Lexer

pub const fn new() -> Self

pub fn tokenize<B: ?Sized + AsRef<[u8]>>( &self, input: &B, ) -> SyntaxResult<Vec<Token>>

Trait Implementations

impl Clone for Lexer

fn clone(&self) -> Lexer

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Lexer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Lexer

fn default() -> Lexer

Returns the “default value” for a type.

impl PartialEq for Lexer

fn eq(&self, other: &Lexer) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Lexer

impl StructuralPartialEq for Lexer