Skip to main content

Tokens

oaks

Type Alias Tokens 

Source 
pub type Tokens<L>
where
    L: Language,
 = Arc<[Token<<L as Language>::TokenType>]>;
Expand description

Output type for lexical analysis operations.

This type alias represents the result of tokenization, containing a vector of tokens and any diagnostic language that occurred during the lexing process.

Aliased Typeยง

pub struct Tokens<L>
where
    L: Language,
{ /* private fields */ }