Struct SemanticToken 

pub struct SemanticToken {
    pub location: ByteSpan,
    pub token_type: SemanticTokenType,
    pub modifiers: Vec<SemanticTokenModifier>,
}

A semantic token with type and modifiers for LSP syntax highlighting.

Represents a single semantic unit in Perl source code with precise location and rich type information for enhanced editor experience.

Performance Characteristics

• Memory: ~32 bytes per token (optimized for large files)
• Serialization: Direct LSP protocol mapping
• Batch processing: Efficient delta updates for incremental parsing

LSP Workflow Integration

Core component in Parse → Index → Navigate → Complete → Analyze pipeline for real-time syntax highlighting with ≤1ms update latency.

Fields

location: ByteSpan

Source location of the token

token_type: SemanticTokenType

Semantic classification of the token

modifiers: Vec<SemanticTokenModifier>

Additional modifiers for enhanced highlighting

Trait Implementations

impl Clone for SemanticToken

fn clone(&self) -> SemanticToken

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SemanticToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.