Struct ChunkConfig 

pub struct ChunkConfig {
    pub max_size: usize,
    pub overlap: usize,
    pub min_size: usize,
    pub respect_sentences: bool,
}

Chunking configuration.

Fields

max_size: usize

Maximum chunk size in characters.

overlap: usize

Overlap between chunks in characters.

min_size: usize

Minimum chunk size (don’t create tiny chunks).

respect_sentences: bool

Split on sentence boundaries when possible.

Implementations

impl ChunkConfig

pub fn short() -> Self

Create config for short chunks (tweets, titles).

pub fn medium() -> Self

Create config for medium chunks (paragraphs).

pub fn long() -> Self

Create config for long chunks (sections).

Trait Implementations

impl Clone for ChunkConfig

fn clone(&self) -> ChunkConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChunkConfig

fn default() -> Self

Returns the “default value” for a type.