Struct RecursiveCharacterTextSplitter 

pub struct RecursiveCharacterTextSplitter { /* private fields */ }

Recursively splits text using a hierarchy of separators.

Tries each separator in order, splitting with the first one that produces chunks small enough. If a chunk is still too large, it recurses with the next separator.

Default separators: ["\n\n", "\n", " ", ""]

Implementations

impl RecursiveCharacterTextSplitter

pub fn new(chunk_size: usize) -> Self

pub fn with_separators(self, separators: Vec<String>) -> Self

pub fn from_language( language: Language, chunk_size: usize, chunk_overlap: usize, ) -> Self

Create a splitter with language-aware separators.

pub fn with_chunk_overlap(self, overlap: usize) -> Self

Trait Implementations

impl TextSplitter for RecursiveCharacterTextSplitter

fn split_text(&self, text: &str) -> Vec<String>

Split a string into chunks.

fn split_documents(&self, docs: Vec<Document>) -> Vec<Document>

Split documents by splitting each document’s content and producing new documents for each chunk. Metadata is preserved on each chunk.