Skip to main content

Module token_wrapper

Module token_wrapper 

Source
Expand description

Lightweight token wrapper for AST integration. Token stream and trivia utilities for the parser. Token wrapper with enhanced position tracking

This module provides a wrapper around lexer tokens that adds line and column information for incremental parsing support.

Structs§

PositionTracker
Position tracker for converting byte offsets to line/column
TokenWithPosition
Token with full position information