Struct TokenInfo 

pub struct TokenInfo {
    pub text: String,
    pub kind: Option<TokenKind>,
}

Information about a found token

Fields

text: String

The token text (truncated if very long)

kind: Option<TokenKind>

The token kind (if identifiable)

Implementations

impl TokenInfo

pub fn new(text: impl Into<String>) -> Self

pub fn with_kind(self, kind: TokenKind) -> Self

pub fn end_of_input() -> Self

Trait Implementations

impl Clone for TokenInfo

fn clone(&self) -> TokenInfo

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenInfo

fn eq(&self, other: &TokenInfo) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for TokenInfo