Enum TokenPattern 

pub enum TokenPattern {
    Exact(TokenKind),
    Category(TokenCategory),
    Any,
    Optional(Box<TokenPattern>),
    Sequence(Vec<TokenPattern>),
    Alternatives(Vec<TokenPattern>),
}

A simple pattern for matching token sequences.

Variants

Exact(TokenKind)

Match a specific token kind.

Category(TokenCategory)

Match any token in the given category.

Any

Match any token (wildcard).

Optional(Box<TokenPattern>)

Match an optional token.

Sequence(Vec<TokenPattern>)

Match a sequence of patterns.

Alternatives(Vec<TokenPattern>)

Match one of the alternatives.

Implementations

impl TokenPattern

pub fn matches_single(&self, tok: &Token) -> bool

Check if a single token matches this pattern (non-recursive).

pub fn try_match(&self, tokens: &[Token]) -> Option<usize>

Try to match this pattern against the start of a token slice. Returns the number of tokens consumed, or None if no match.

pub fn find_all<'a>(&self, tokens: &'a [Token]) -> Vec<&'a [Token]>

Find all non-overlapping matches of this pattern in a slice.

Trait Implementations

impl Clone for TokenPattern

fn clone(&self) -> TokenPattern

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenPattern

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.