Enum ChunkStrategy 

pub enum ChunkStrategy {
    FixedSize {
        size: usize,
        overlap: usize,
    },
    SentenceBoundary {
        max_chunk_chars: usize,
        overlap_sentences: usize,
    },
    Paragraph {
        max_chunk_chars: usize,
    },
    Semantic {
        max_chunk_chars: usize,
        similarity_threshold: f64,
    },
}

Strategy that controls how a document is split into chunks.

Variants

FixedSize

Split by character count with configurable overlap.

Fields

size: usize

Window size in characters.

overlap: usize

Number of characters to overlap between consecutive chunks.

SentenceBoundary

Split at sentence boundaries (., !, ? followed by whitespace).

Fields

max_chunk_chars: usize

Maximum chunk length in characters.

overlap_sentences: usize

Number of sentences from the end of the previous chunk that are prepended to the start of the next chunk as overlap.

Paragraph

Split at double-newline paragraph boundaries.

Fields

max_chunk_chars: usize

Maximum chunk length in characters; oversized paragraphs are further split at sentence boundaries.

Semantic

Group sentences whose cumulative length stays within max_chunk_chars. similarity_threshold is reserved for future embedding-based splitting.

Fields

max_chunk_chars: usize

Maximum chunk length in characters.

similarity_threshold: f64

Reserved — similarity threshold for future embedding-based grouping.

Trait Implementations

impl Clone for ChunkStrategy

fn clone(&self) -> ChunkStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ChunkStrategy

fn eq(&self, other: &ChunkStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for ChunkStrategy