Expand description
Zero-copy tokenizer for DX Machine format
Uses SIMD-accelerated scanning via memchr for maximum performance. Operates directly on byte slices without allocations.
Structs§
- Tokenizer
- Zero-copy tokenizer
Enums§
- Token
- Token types in DX format