Struct TokenData 

pub struct TokenData {
    pub kind: String,
    pub text: String,
    pub start: usize,
    pub end: usize,
}

Individual token data for lexer testing.

Represents a single token with its kind, text content, and position information used for testing lexer output.

Fields

kind: String

The kind of the token as a string.

text: String

The text content of the token.

start: usize

The start position of the token in the source.

end: usize

The end position of the token in the source.

Trait Implementations

impl Debug for TokenData

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for TokenData

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for TokenData

fn eq(&self, other: &TokenData) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for TokenData

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for TokenData