Enum ketos::lexer::Token

pub enum Token<'lex> {
    LeftParen,
    RightParen,
    DocComment(&'lex str),
    Float(&'lex str),
    Integer(&'lex str, u32),
    Ratio(&'lex str),
    Char(&'lex str),
    String(&'lex str),
    Byte(&'lex str),
    Bytes(&'lex str),
    Path(&'lex str),
    Name(&'lex str),
    Keyword(&'lex str),
    BackQuote,
    Comma,
    CommaAt,
    Quote,
    End,
}

Represents a single unit of code input.

Variants

LeftParen

Left parenthesis (

RightParen

Right parenthesis )

DocComment(&'lex str)

A series of line comments beginning with ;;, used to document declared values.

Float(&'lex str)

Floating point literal

Integer(&'lex str, u32)

Integer literal in a given radix

Ratio(&'lex str)

Ratio literal

Char(&'lex str)

Character literal

String(&'lex str)

String literal

Byte(&'lex str)

Byte literal

Bytes(&'lex str)

Byte string literal

Path(&'lex str)

Path literal

Name(&'lex str)

Identifier name

Keyword(&'lex str)

Identifier keyword

BackQuote

Backtick quote `

Comma

Comma ,

CommaAt

Comma followed by at ,@

Quote

Single-quote '

End

End of input stream

Methods

impl<'lex> Token<'lex>

pub fn name(&self) -> &'static str

Returns a human-readable name of a token.

Trait Implementations

impl<'lex> Clone for Token<'lex>

fn clone(&self) -> Token<'lex>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'lex> Copy for Token<'lex>

impl<'lex> Debug for Token<'lex>

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl<'lex> Eq for Token<'lex>

impl<'lex> PartialEq<Token<'lex>> for Token<'lex>

fn eq(&self, other: &Token<'lex>) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Token<'lex>) -> bool

This method tests for !=.

impl<'lex> StructuralEq for Token<'lex>

impl<'lex> StructuralPartialEq for Token<'lex>