Enum Token 

pub enum Token {
    LeftBrace,
    RightBrace,
    LeftBracket,
    RightBracket,
    Comma,
    Colon,
    Null,
    True,
    False,
    Newline,
    String,
    UnquotedString,
    Number,
    SingleLineComment,
    MultiLineComment,
    Eof,
    Error,
}

Variants

LeftBrace

Opening curly brace ‘{’ for objects.

RightBrace

Closing curly brace ‘}’ for objects.

LeftBracket

Opening square bracket ‘[’ for arrays.

RightBracket

Closing square bracket ‘]’ for arrays.

Comma

Comma ‘,’ separator.

Colon

Colon ‘:’ separator between keys and values.

Null

JSON null literal.

True

JSON true literal.

False

JSON false literal.

Newline

Newline character ‘\n’ or ‘\r’ (used for newline-as-comma feature).

String

Whitespace (spaces, tabs) - skipped during parsing. String literal (double or single quoted).

UnquotedString

Unquoted string (used for object keys in forgiving mode). (Basic, will be refined)

Number

Numeric literal. (Basic, will be refined)

SingleLineComment

Single-line comment starting with ‘//’ or ‘#’.

MultiLineComment

Multi-line comment enclosed in ‘/* */’.

Eof

End of file/input. (Logos usually handles this implicitly)

Error

Represents a lexical error.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Token

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'s> Logos<'s> for Token

type Error = ()

Error type returned by the lexer. This can be set using #[logos(error = MyError)]. Defaults to () if not set.

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

fn lex(lex: &mut Lexer<'s, Token>)

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self>

where Self::Extras: Default,

Create a new instance of a Lexer that will produce tokens implementing this Logos.

fn lexer_with_extras( source: &'source Self::Source, extras: Self::Extras, ) -> Lexer<'source, Self>

Create a new instance of a Lexer with the provided Extras that will produce tokens implementing this Logos.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Token