Module lexer

Module lexer 

Source
Expand description

High-performance lexer with comprehensive implicit multiplication

This module provides ultra-fast implicit multiplication processing with comprehensive support for LaTeX, Wolfram, and standard mathematical notation.

Features:

  • Multi-format support: LaTeX (\pi), Wolfram ([Pi]), Standard (pi)
  • Smart token recognition with O(1) HashMap lookups
  • Intelligent operator and function call preservation
  • Precomputed multiplication rules matrix for maximum speed

Re-exports§

pub use implicit_multiplication::*;
pub use multiplication_rules::*;
pub use rules::*;
pub use standard_tokens::*;
pub use token_maps::*;
pub use wolfram_tokens::*;

Modules§

implicit_multiplication
High-performance implicit multiplication processor
multiplication_rules
Precomputed implicit multiplication rules matrix
rules
Token classification rules for implicit multiplication
standard_tokens
Standard mathematical notation token classification
token_maps
Ultra-fast token classification maps
wolfram_tokens
Wolfram Language token classification