Skip to main content

Chunker

aprender_rag::chunk

Trait Chunker 

Source 
pub trait Chunker: Send + Sync {
    // Required methods
    fn chunk(&self, document: &Document) -> Result<Vec<Chunk>>;
    fn estimate_chunks(&self, document: &Document) -> usize;
}
Expand description

Trait for document chunkers

Required Methods§

Source

fn chunk(&self, document: &Document) -> Result<Vec<Chunk>>

Split document into chunks

Source

fn estimate_chunks(&self, document: &Document) -> usize

Estimate chunk count without materializing

Implementors§