Enum kailua_syntax::lex::Tok

pub enum Tok {
    Error,
    Comment,
    Punct(Punct),
    Keyword(Keyword),
    Num(f64),
    Name(Name),
    Str(Str),
    EOF,
}

A token.

Variants

Error

A token which is distinct from all other tokens.

The lexer emits this token on an error.

Comment

A comment token. The parser should ignore this.

The shebang line (the first line starting with #) is also considered as a comment.

Punct(Punct)

A punctuation.

Keyword(Keyword)

A keyword.

Num(f64)

A number.

Name(Name)

A name (either an identifier or a quoted name in the meta block).

Str(Str)

A string (either "string" or [[string]]).

EOF

The end of file.

A valid stream of tokens is expected to have only one EOF token at the end.

Trait Implementations

impl Clone for Tok

fn clone(&self) -> Tok

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Tok

fn fmt(&self, __arg_0: &mut Formatter) -> Result

Formats the value using the given formatter.

impl PartialEq for Tok

fn eq(&self, __arg_0: &Tok) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, __arg_0: &Tok) -> bool

This method tests for !=.

impl Localize for Tok

fn fmt_localized(&self, f: &mut Formatter, locale: Locale) -> Result

impl<'a> Localize for &'a Tok

fn fmt_localized(&self, f: &mut Formatter, locale: Locale) -> Result