Enum TextDensity 

pub enum TextDensity {
    Low,
    Medium,
    High,
}

CJK text density classification for adaptive scoring.

Different CJK documents have different character densities:

• Academic papers, formal documents: High density (many chars per page)
• Children’s books, sparse layouts: Low density (fewer chars per page)
• Most books: Medium density

Density affects how aggressively punctuation creates boundaries.

Variants

Low

Low density: Sparse text with significant whitespace Example: Children’s books, formatted documents with large margins Characteristic: < 500 characters per page equivalent

Medium

Medium density: Normal text with standard spacing Example: Most books, regular documents Characteristic: 500-2000 characters per page equivalent

High

High density: Dense text with minimal whitespace Example: Academic papers, technical documents, legal text Characteristic: > 2000 characters per page equivalent

Implementations

impl TextDensity

pub fn classify(char_count: usize, page_count: usize) -> Self

Classify text density based on character count in a sample.

This uses a simple heuristic: count characters in a representative sample and estimate document-wide density.

Arguments

• char_count - Total characters processed so far
• page_count - Number of pages processed

Returns

Classified density level

pub fn score_multiplier(&self) -> f32

Get density multiplier for adaptive scoring.

Returns a factor (0.5-1.5) to multiply base scores:

• Low density (0.6): More conservative, require higher scores for boundaries
• Medium density (1.0): No adjustment
• High density (1.4): More aggressive, lower scores trigger boundaries

Trait Implementations

impl Clone for TextDensity

fn clone(&self) -> TextDensity

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TextDensity

impl Debug for TextDensity

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TextDensity

impl PartialEq for TextDensity

fn eq(&self, other: &TextDensity) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TextDensity