Struct TokenShape 

pub struct TokenShape {
    pub name: String,
    pub pat: BytePat,
    pub window: usize,
    pub precedence: Precedence,
    pub id: u8,
    pub guard: Option<fn(&[u8]) -> bool>,
}

One declared token shape.

Fields

name: String

The name the \{name} atom uses.

pat: BytePat

The whole-anchored byte-pattern, bounded by construction.

window: usize

Longest byte length this shape can match, from BytePat::max_len.

precedence: Precedence

Where it sits against the built-in cascade.

id: u8

The payload of the crate::token::TokenKind::Custom the lexer emits for it.

guard: Option<fn(&[u8]) -> bool>

A check on the bytes the pattern accepted, where the shape’s standard defines one: a token the check refuses is not this shape.

Trait Implementations

impl Clone for TokenShape

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenShape

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.