Struct TokenInfo

pub struct TokenInfo { /* private fields */ }

A struct to hold information about the tokens in the tokenized buffer.

Implementations

impl TokenInfo

pub fn channel(&self) -> TokenChannel

Returns the channel of the token.

pub fn token_type(&self) -> TokenType

Returns the type of the token.

pub fn byte_offset(&self) -> ByteOffset

Returns the byte offset of the token, 0-based.

pub fn start(&self) -> CharOffset

Returns the char offset of the token, 0-based.

pub fn line(&self) -> u32

Returns the line number of the token, 1-based.

pub fn payload(&self) -> Payload

The token payload.

Trait Implementations

impl Clone for TokenInfo

fn clone(&self) -> TokenInfo

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenInfo

fn eq(&self, other: &TokenInfo) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenInfo

impl StructuralPartialEq for TokenInfo