Struct StatisticalFilter 

pub struct StatisticalFilter { /* private fields */ }

Statistical token filter (model-free alternative to LLMLingua)

Implementations

impl StatisticalFilter

pub fn new(config: StatisticalFilterConfig) -> Self

Create a new statistical filter

impl StatisticalFilter

pub fn score_words(&self, text: &str) -> Vec<WordImportance>

Calculate importance scores for all tokens Score words in text by importance

pub fn compress(&self, text: &str) -> String

Filter text keeping only high-importance words

pub fn compress_with_format( &self, text: &str, format: OutputFormat, ) -> Result<CompressionResult, Box<dyn Error>>

Compress text and optionally render to image.

This method performs statistical compression and can output the result as either plain text or as a 1024x1024 PNG image for vision model consumption.

Arguments

• text - The input text to compress
• format - Output format (Text or Image)

Returns

A CompressionResult containing the compressed text and optional image data.

Example

use compression_prompt::{StatisticalFilter, OutputFormat};

let filter = StatisticalFilter::default();
let result = filter.compress_with_format("long text...", OutputFormat::Image)?;

if let Some(img_data) = result.image_data {
    std::fs::write("output.png", img_data)?;
}

Trait Implementations

impl Debug for StatisticalFilter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for StatisticalFilter

fn default() -> Self

Returns the “default value” for a type.