Struct RecursiveCharacterTextSplitter 

pub struct RecursiveCharacterTextSplitter { /* private fields */ }

Recursive character-based text splitter

Tries to split on natural boundaries in this order:

1. Double newlines (paragraphs)
2. Single newlines (lines)
3. Sentences (periods, question marks, exclamation points)
4. Words (spaces)
5. Characters (last resort)

Example

use vecstore::text_splitter::{RecursiveCharacterTextSplitter, TextSplitter};

let splitter = RecursiveCharacterTextSplitter::new(1000, 100);
let text = "First paragraph.\n\nSecond paragraph with more content...";
let chunks = splitter.split_text(text)?;

Implementations

impl RecursiveCharacterTextSplitter

pub fn new(chunk_size: usize, chunk_overlap: usize) -> Self

Create a new recursive splitter

Arguments

• chunk_size - Maximum characters per chunk
• chunk_overlap - Characters to overlap between chunks (for context continuity)

Example

use vecstore::text_splitter::RecursiveCharacterTextSplitter;

// 500 char chunks with 50 char overlap
let splitter = RecursiveCharacterTextSplitter::new(500, 50);

pub fn with_separators(self, separators: Vec<String>) -> Self

Create with custom separators

Trait Implementations

impl TextSplitter for RecursiveCharacterTextSplitter

fn split_text(&self, text: &str) -> Result<Vec<String>>

Split text into chunks

fn split_with_metadata(&self, text: &str) -> Result<Vec<TextChunk>>

Split text into chunks with metadata (position, length, etc.)