Enum Token 

pub enum Token {
    KwAgent,
    KwBelief,
    KwOn,
    KwStart,
    KwStop,
    KwMessage,
    KwInfer,
    KwSpawn,
    KwAwait,
    KwSend,
    KwEmit,
    KwRun,
    KwFn,
    KwLet,
    KwReturn,
    KwIf,
    KwElse,
    KwFor,
    KwWhile,
    KwLoop,
    KwBreak,
    KwIn,
    KwSelf,
    KwTrue,
    KwFalse,
    KwMod,
    KwUse,
    KwPub,
    KwAs,
    KwSuper,
    KwRecord,
    KwEnum,
    KwMatch,
    KwConst,
    KwReceives,
    KwReceive,
    KwFails,
    KwTry,
    KwCatch,
    KwError,
    KwTool,
    KwTest,
    KwMock,
    TyInt,
    TyFloat,
    TyBool,
    TyString,
    TyUnit,
    TyList,
    TyOption,
    TyInferred,
    TyAgent,
    TyError,
    TyErrorKind,
    TyFn,
    TyMap,
    TyResult,
    IntLit,
    FloatLit,
    StringLit,
    Ident,
    LBrace,
    RBrace,
    LParen,
    RParen,
    LBracket,
    RBracket,
    Comma,
    ColonColon,
    Colon,
    Dot,
    Arrow,
    FatArrow,
    At,
    Eq,
    EqEq,
    Ne,
    Lt,
    Gt,
    Le,
    Ge,
    Plus,
    Minus,
    Star,
    Slash,
    Bang,
    And,
    Or,
    Pipe,
    PlusPlus,
    Percent,
    Semicolon,
}

All tokens in the Sage language.

Variants

KwAgent

KwBelief

KwOn

KwStart

KwStop

KwMessage

KwInfer

KwSpawn

KwAwait

KwSend

KwEmit

KwRun

KwFn

KwLet

KwReturn

KwIf

KwElse

KwFor

KwWhile

KwLoop

KwBreak

KwIn

KwSelf

KwTrue

KwFalse

KwMod

KwUse

KwPub

KwAs

KwSuper

KwRecord

KwEnum

KwMatch

KwConst

KwReceives

KwReceive

KwFails

KwTry

KwCatch

KwError

KwTool

KwTest

RFC-0012: Test declaration keyword.

KwMock

RFC-0012: Mock keyword for LLM mocking.

TyInt

TyFloat

TyBool

TyString

TyUnit

TyList

TyOption

TyInferred

TyAgent

TyError

TyErrorKind

TyFn

Function type keyword: Fn

TyMap

Map type keyword: Map

TyResult

Result type keyword: Result

IntLit

Integer literal (e.g., 42, -7).

FloatLit

Float literal (e.g., 3.14, -0.5).

StringLit

String literal (e.g., "hello"). Supports escape sequences: \n, \t, \r, \, "

Ident

Identifier (e.g., foo, myAgent, _private).

LBrace

RBrace

LParen

RParen

LBracket

RBracket

Comma

ColonColon

Colon

Dot

Arrow

FatArrow

At

Annotation marker for test attributes.

Eq

EqEq

Ne

Lt

Gt

Le

Ge

Plus

Minus

Star

Slash

Bang

And

Or

Pipe

Single pipe for closure parameters: |

PlusPlus

String concatenation operator.

Percent

Modulo/remainder operator.

Semicolon

Statement terminator.

Implementations

impl Token

pub fn is_keyword(&self) -> bool

Returns true if this token is a keyword.

pub fn is_type_keyword(&self) -> bool

Returns true if this token is a type keyword.

pub fn is_literal(&self) -> bool

Returns true if this token is a literal.

pub fn is_operator(&self) -> bool

Returns true if this token is an operator.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for Token

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl<'s> Logos<'s> for Token

type Error = ()

Error type returned by the lexer. This can be set using #[logos(error = MyError)]. Defaults to () if not set.

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

fn lex(lex: &mut Lexer<'s, Self>)

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self>

where Self::Extras: Default,

Create a new instance of a Lexer that will produce tokens implementing this Logos.

fn lexer_with_extras( source: &'source Self::Source, extras: Self::Extras, ) -> Lexer<'source, Self>

Create a new instance of a Lexer with the provided Extras that will produce tokens implementing this Logos.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Token

impl StructuralPartialEq for Token