Crate uqa_analysis 

Text analysis pipeline: char filters, tokenizers, token filters, composable Analyzer, and a global named-analyzer registry.

Re-exports

pub use normalization::NormalizationConfig;

pub use analyzer::keyword_analyzer;

pub use analyzer::standard_analyzer;

pub use analyzer::standard_cjk_analyzer;

pub use analyzer::whitespace_analyzer;

pub use analyzer::Analyzer;

pub use analyzer::CompiledAnalyzer;

pub use char_filter::CharFilter;

pub use descriptor::AnalyzerDescriptor;

pub use descriptor::AnalyzerFingerprint;

pub use descriptor::AnalyzerLimits;

pub use descriptor::TokenLengthPolicy;

pub use error::AnalysisError;

pub use error::AnalysisResult;

pub use highlight::highlight;

pub use highlight::highlight_budgeted;

pub use highlight::highlight_compiled;

pub use highlight::highlight_compiled_budgeted;

pub use highlight::HighlightOptions;

pub use registry::builtin_analyzer_names;

pub use registry::drop_analyzer;

pub use registry::get_analyzer;

pub use registry::is_builtin_analyzer;

pub use registry::list_analyzers;

pub use registry::register_analyzer;

pub use registry::DEFAULT_ANALYZER_NAME;

pub use resources::AnalyzerCacheStats;

pub use resources::AnalyzerResources;

pub use resources::AnalyzerResourcesBuilder;

pub use source::FilteredText;

pub use source::SourceOffsets;

pub use source::TextCoordinates;

pub use term::TokenTerm;

pub use token::AnalysisToken;

pub use token::AnalyzedText;

pub use token_filter::SynonymFileError;

pub use token_filter::TokenFilter;

pub use tokenizer::Tokenizer;

Modules

analyzer

Composable text analysis pipeline.

char_filter

Character-level filters that run before tokenization.

descriptor

Versioned resolved analyzer inputs, runtime profiles, and canonical JSON identity.

error

Errors produced while executing an analysis pipeline.

highlight

Search-result highlighting.

normalization

Explicit normalization plans retain profile identity independently of analysis stages.

porter

Porter (1980) stemming algorithm.

registry

Named Analyzer registry. Generic and feature-enabled language built-ins are immutable; custom analyzers use other names.

resources

Bounded ownership of immutable compiled analyzer revisions.

source

Unicode source coordinates and composed character-filter edit maps.

term

Lossless term identity for Unicode strings and unpaired UTF-16 units.

token

Structured analysis tokens and end-of-stream position state.

token_filter

Token-level filters that run after tokenization.

tokenizer

Tokenizers for the analysis pipeline. An Analyzer owns exactly one tokenizer.