Struct OffsetCorrection 

pub struct OffsetCorrection {
    pub filtered: usize,
    pub cumulative_diff: isize,
}

Character filters transform raw text before tokenization.

Each filter receives the full input string and returns the transformed string plus an offset correction map so that token offsets can be mapped back to positions in the original text.

See [[analyzers#Character Filters]]. A correction entry mapping a position in the filtered text back to the original text. Used to fix token offsets after character filtering.

Fields

filtered: usize

Byte offset in the filtered text.

cumulative_diff: isize

How many bytes were removed (positive) or added (negative as wrapping) up to this point. To recover the original offset: original_offset = filtered_offset + cumulative_diff

Trait Implementations

impl Clone for OffsetCorrection

fn clone(&self) -> OffsetCorrection

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OffsetCorrection

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.