matcher_rs 0.15.3

A high-performance matcher designed to solve LOGICAL and TEXT VARIATIONS problems in word matching, implemented in Rust.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33

//! Low-level text transformation engines.
//!
//! This module provides the building blocks used by the step registry
//! ([`super::step`]) and pipeline executor to transform
//! input text before pattern matching. Each sub-module implements one class of
//! transformation:
//!
//! - [`constants`] -- Pre-compiled binary tables (page tables, bitsets)
//!   embedded at build time by `build.rs`.
//! - [`page_table`] -- Shared two-stage page-table infrastructure used by the
//!   replacement engines below.
//! - [`variant_norm`] -- CJK variant normalization (Traditional→Simplified,
//!   Kyūjitai→Shinjitai, half-width katakana→full-width).
//! - [`normalize`] -- Unicode NFKC normalization + casefolding.
//! - [`romanize`] -- CJK romanization (Pinyin, Romaji, Revised Romanization).
//! - [`delete`] -- A flat Unicode bitset engine ([`delete::DeleteMatcher`])
//!   that strips configured codepoints from text, with a fast ASCII LUT path.
//! - [`simd`] -- SIMD-accelerated byte-skip helpers that let the replace and
//!   delete engines jump over long runs of irrelevant ASCII bytes in a single
//!   instruction (AVX2 / NEON / portable `std::simd` fallback).
//!
//! All types in this module are `pub(crate)` -- they are internal
//! implementation details consumed by the higher-level [`super::step`] and
//! the parent module.
pub(crate) mod constants;
pub(crate) mod delete;
pub(crate) mod filter;
pub(crate) mod normalize;
pub(crate) mod page_table;
pub(crate) mod romanize;
pub(crate) mod simd;
pub(crate) mod utf8;
pub(crate) mod variant_norm;