Struct AdaptiveCompressor 

pub struct AdaptiveCompressor { /* private fields */ }

Budget-based adaptive document compressor.

Implementations

impl AdaptiveCompressor

pub fn new() -> Self

Creates a compressor with the default stopword list.

The default list includes common English function words (ASCII) and standalone Korean connective words (non-ASCII). For domain-specific stopwords use Self::with_stopwords.

pub fn with_stopwords(stopwords: Vec<String>) -> Self

Creates a compressor with a fully custom stopword list.

Stopwords are partitioned at construction time:

• ASCII words → indexed into a single Aho-Corasick automaton (case-insensitive).
• Non-ASCII words → stored as plain strings for token-level matching.

pub fn has_stopwords(&self) -> bool

Returns true when no stopwords are configured (both lists empty).

pub fn compress( &self, nodes: Vec<DocNode>, cfg: &CompressionConfig, ) -> Vec<DocNode>

Applies compression to the node list and returns the result.

Stopword removal is also skipped at FidelityLevel::Lossless.

Trait Implementations

impl Default for AdaptiveCompressor

fn default() -> Self

Returns the “default value” for a type.