Expand description
Option A: Aho-Corasick based multi-pattern scanner with multi-locale support
This scans the input text once and identifies all potential date-related tokens (months, weekdays, time units, casual words) in a single pass.
Benefits:
- Single pass over input text
- O(n + m + z) complexity (n=text, m=patterns, z=matches)
- SIMD-optimized by the aho-corasick crate
Structs§
- Token
- A token found by the scanner pre-pass.
- Token
Scanner - Locale-aware token scanner used by parser prefilters.
Enums§
- Token
Type - Categories of token the scanner can emit.