Struct RecursiveChunker 

pub struct RecursiveChunker { /* private fields */ }

Hierarchical chunker: tries paragraphs → sentences → fixed-char fallback.

• First splits by \n\n (paragraphs)
• If a paragraph is still larger than max_chunk_size, splits by sentences
• If a sentence is still too large, uses fixed-size character splitting

Example

use traitclaw_rag::chunker::{Chunker, RecursiveChunker};

let chunker = RecursiveChunker::new(200);
let text = "Para 1.\n\nPara 2 sentence one. Para 2 sentence two.";
let chunks = chunker.chunk(text);
assert!(!chunks.is_empty());

Implementations

impl RecursiveChunker

pub fn new(max_chunk_size: usize) -> Self

Create a new RecursiveChunker with the given max chunk size in characters.

Panics

Panics if max_chunk_size == 0.

Trait Implementations

impl Chunker for RecursiveChunker

fn chunk(&self, text: &str) -> Vec<String>

Split text into a list of chunks.