Enum CharFilter 

pub enum CharFilter {
    HTMLStrip,
    CJKWidth,
    Mapping {
        mapping: BTreeMap<String, String>,
    },
    PatternReplace {
        pattern: String,
        replacement: String,
    },
}

Variants

HTMLStrip

CJKWidth

Fold fullwidth ASCII and halfwidth Katakana, preserving original source spans.

use uqa_analysis::CharFilter;
let filtered = CharFilter::CJKWidth.filter_with_offsets("ｶﾞＡ①")?;
assert_eq!(filtered.as_str(), "ガA①");
assert_eq!(filtered.source_offsets(0..3)?.utf16, 0..2);

Mapping

Fields

mapping: BTreeMap<String, String>

PatternReplace

Fields

pattern: String

replacement: String

Implementations

impl CharFilter

pub fn validate(&self) -> AnalysisResult<()>

Validate configuration without filtering input.

pub fn filter(&self, text: &str) -> AnalysisResult<String>

pub fn filter_with_offsets<'a>( &self, text: &'a str, ) -> AnalysisResult<FilteredText<'a>>

Transform text while retaining source coordinates for the result.

pub fn filter_mapped<'a>( &self, text: FilteredText<'a>, ) -> AnalysisResult<FilteredText<'a>>

Apply this stage to previously filtered text without losing its original source.

pub fn filter_with_offsets_budgeted<'a>( &self, text: &'a str, budget: &MemoryBudget, poll: &mut dyn FnMut() -> AnalysisResult<()>, ) -> AnalysisResult<FilteredText<'a>>

Transform a borrowed input while retaining source buffers and regex search workspace under the caller’s byte allowance. Immutable configuration preparation is separate. Literal, built-in HTML, regex range and capture searches, source copying, and coordinate construction poll during execution. Search scratch is released before returning the retained source result.

use uqa_analysis::CharFilter;
use uqa_core::memory::MemoryBudget;
let budget = MemoryBudget::new(16 * 1024);
let filtered = CharFilter::HTMLStrip.filter_with_offsets_budgeted(
    "<b>한&amp;🙂</b>", &budget, &mut || Ok(()),
)?;
let retained = filtered.clone();
drop(filtered);
assert_eq!(retained.as_str(), " 한&🙂 ");
assert_eq!(retained.source_offsets(1..4)?.utf8, 3..6);
assert!(budget.used() > 0);
drop(retained);
assert_eq!(budget.used(), 0);

pub fn filter_mapped_budgeted<'a>( &self, text: FilteredText<'a>, budget: &MemoryBudget, poll: &mut dyn FnMut() -> AnalysisResult<()>, ) -> AnalysisResult<FilteredText<'a>>

New source, edit, and coordinate buffers use budget; retained input allocations keep their original shared leases.

Trait Implementations

impl Clone for CharFilter

fn clone(&self) -> CharFilter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CharFilter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CharFilter

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CharFilter

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.