Struct CommonToken 

pub struct CommonToken { /* private fields */ }

Implementations

impl CommonToken

pub fn new(token_type: i32) -> Self

pub fn eof( source_name: impl Into<Rc<str>>, index: usize, line: usize, column: usize, ) -> Self

pub fn with_text(self, text: impl Into<Rc<str>>) -> Self

pub fn with_source_text( self, input: Rc<str>, start_byte: u32, stop_byte: u32, ) -> Self

pub const fn with_span(self, start: usize, stop: usize) -> Self

pub const fn with_position(self, line: usize, column: usize) -> Self

pub const fn with_channel(self, channel: i32) -> Self

pub fn with_source_name(self, source_name: impl Into<Rc<str>>) -> Self

pub const fn set_token_index(&mut self, token_index: isize)

impl CommonToken

pub fn text(&self) -> &str

The token’s text, empty when unset — ANTLR’s getText() shape, which generated test actions print directly (token.text() in {}).

This inherent method intentionally shadows the Option-returning Token::text trait method on concrete CommonToken values; generic code keeps the trait signature.

Trait Implementations

impl Clone for CommonToken

fn clone(&self) -> CommonToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CommonToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for CommonToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for CommonToken

impl PartialEq for CommonToken

fn eq(&self, other: &CommonToken) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CommonToken

impl Token for CommonToken

fn token_type(&self) -> i32

fn channel(&self) -> i32

fn start(&self) -> usize

Zero-based absolute start index measured in Unicode scalar values.

fn stop(&self) -> usize

Zero-based absolute inclusive stop index measured in Unicode scalar values.

fn token_index(&self) -> isize

fn line(&self) -> usize

One-based source line where the token starts.

fn column(&self) -> usize

Zero-based source column where the token starts, measured in Unicode scalar values from the start of line.

fn text(&self) -> Option<&str>

fn source_name(&self) -> &str

fn start_byte(&self) -> usize

Zero-based absolute start offset measured in UTF-8 bytes.

fn stop_byte(&self) -> usize

Zero-based exclusive end offset measured in UTF-8 bytes.

fn interval(&self) -> TextInterval

fn byte_span(&self) -> Range<usize>

Zero-based UTF-8 byte span for the token text.