matcher_rs 0.14.2

A high-performance matcher designed to solve LOGICAL and TEXT VARIATIONS problems in word matching, implemented in Rust.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

//! Low-level text transformation engines.
//!
//! This module provides the building blocks used by the step registry
//! ([`super::step`]) and pipeline executor ([`super::api`]) to transform
//! input text before pattern matching. Each sub-module implements one class of
//! transformation:
//!
//! - [`constants`] -- Pre-compiled binary tables (page tables, bitsets)
//!   embedded at build time by `build.rs`.
//! - [`replace`] -- Text-replacement engines, each in its own sub-module:
//!   [`replace::VariantNormMatcher`] (Traditional→Simplified, page-table),
//!   [`replace::RomanizeMatcher`] (CJK romanization, page-table),
//!   [`replace::NormalizeMatcher`] (Unicode normalization, page-table + fused scan).
//! - [`delete`] -- A flat Unicode bitset engine ([`delete::DeleteMatcher`])
//!   that strips configured codepoints from text, with a fast ASCII LUT path.
//! - [`simd`] -- SIMD-accelerated byte-skip helpers that let the replace and
//!   delete engines jump over long runs of irrelevant ASCII bytes in a single
//!   instruction (AVX2 / NEON / portable `std::simd` fallback).
//!
//! All types in this module are `pub(crate)` -- they are internal implementation
//! details consumed by the higher-level [`super::step`] and
//! [`super::api`] modules.
pub(crate) mod constants;
pub(crate) mod delete;
pub(crate) mod replace;
pub(crate) mod simd;
pub(crate) mod utf8;