Trait tokenizer_lib::TokenTrait
source · pub trait TokenTrait: PartialEq {
// Provided method
fn is_skippable(&self) -> bool { ... }
}
Expand description
PartialEq is required for comparing tokens with TokenReader::expect_next
Provided Methods§
sourcefn is_skippable(&self) -> bool
fn is_skippable(&self) -> bool
Use this for nully tokens. Will be skipped under TokenReader::expect_next