Trait tokenizer_lib::TokenTrait

pub trait TokenTrait: PartialEq {
    // Provided method
    fn is_skippable(&self) -> bool { ... }
}

PartialEq is required for comparing tokens with TokenReader::expect_next

Provided Methods

fn is_skippable(&self) -> bool

Use this for nully tokens. Will be skipped under TokenReader::expect_next

Implementors