Crate uqa_analysis 

Text analysis pipeline: char filters, tokenizers, token filters, composable Analyzer, and a global named-analyzer registry.

Re-exports

pub use analyzer::keyword_analyzer;

pub use analyzer::standard_analyzer;

pub use analyzer::standard_cjk_analyzer;

pub use analyzer::whitespace_analyzer;

pub use analyzer::Analyzer;

pub use char_filter::CharFilter;

pub use error::AnalysisError;

pub use error::AnalysisResult;

pub use highlight::highlight;

pub use highlight::HighlightOptions;

pub use registry::drop_analyzer;

pub use registry::get_analyzer;

pub use registry::list_analyzers;

pub use registry::register_analyzer;

pub use registry::DEFAULT_ANALYZER_NAME;

pub use token_filter::SynonymFileError;

pub use token_filter::TokenFilter;

pub use tokenizer::Tokenizer;

Modules

analyzer

Composable text analysis pipeline.

char_filter

Character-level filters that run before tokenization.

error

Errors produced while executing an analysis pipeline.

highlight

Search-result highlighting.

porter

Porter (1980) stemming algorithm.

registry

Named Analyzer registry. Built-in entries (whitespace, standard, standard_cjk, keyword) are immutable. Users register custom analyzers under any other name; built-in names cannot be overwritten or dropped.

token_filter

Token-level filters that run after tokenization.

tokenizer

Tokenizers for the analysis pipeline. An Analyzer owns exactly one tokenizer.