Skip to main content

Module vectorize

Module vectorize 

Source
Expand description

Vectorized (SIMD) string matching for improved compression ratios

Provides an enhanced LZ77 matcher that uses longer hash chains and wider match scanning for text-heavy data. Activation is gated by a heuristic that checks string density (printable ASCII ratio > 70%) and entropy (< 6.0 bits/byte).

Functionsยง

should_use_vectorized
Decide whether vectorized matching should be used for the given data.