Struct CompiledAnalyzer 

pub struct CompiledAnalyzer { /* private fields */ }

A frozen pipeline with compiled expressions, fixed stop sets, and resolved synonym maps.

Implementations

impl CompiledAnalyzer

pub fn descriptor(&self) -> &Arc<AnalyzerDescriptor>

pub fn analyze_tokens(&self, text: &str) -> AnalysisResult<AnalyzedText>

Analyze with independent output/source state and no expression compilation or file resolution.

pub fn analyze_tokens_budgeted( &self, text: &str, budget: &MemoryBudget, poll: impl FnMut() -> AnalysisResult<()>, ) -> AnalysisResult<Budgeted<AnalyzedText>>

Execute all prepared stages with one allowance for runtime buffers and retained output.

Immutable compiled resources and borrowed input have separate owners. Character maps, tokenization, common/Korean filters and source projections share this allowance. Errors return no partial output. Prepared regex automata retain analysis-owned search workspaces and poll during traversal and capture resolution.

use uqa_analysis::standard_analyzer;
use uqa_core::memory::MemoryBudget;
let compiled = standard_analyzer("english").compile()?;
let budget = MemoryBudget::new(64 * 1024);
let result = compiled.analyze_tokens_budgeted("The cats and", &budget, || Ok(()))?;
assert_eq!(result.tokens()[0].term(), "cat");
assert_eq!(result.final_position_increment(), 1);
drop(result);
assert_eq!(budget.used(), 0);

pub fn analyze(&self, text: &str) -> AnalysisResult<Vec<String>>

pub fn normalize(&self, text: &str) -> AnalysisResult<String>

Normalize complete input with its retained plan, independently of analysis stages.

pub fn normalize_budgeted( &self, text: &str, budget: &MemoryBudget, poll: impl FnMut() -> AnalysisResult<()>, ) -> AnalysisResult<Budgeted<String>>

Normalize complete text with one retained output allowance and cancellation callback.

impl CompiledAnalyzer

pub fn analyze_diagnostic_budgeted( &self, text: &str, budget: &MemoryBudget, poll: impl FnMut() -> AnalysisResult<()>, ) -> AnalysisResult<Budgeted<String>>

Analyze and encode the complete token graph, source end state, and immutable revision.

Analysis and JSON output share the supplied allowance. The token stream remains reserved until encoding finishes, and cancellation is checked while writing. The returned string retains its output reservation.

Trait Implementations

impl Debug for CompiledAnalyzer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.