Struct RecursiveCharacterTextSplitter 

pub struct RecursiveCharacterTextSplitter<S = CharSizer> { /* private fields */ }

A text splitter that recursively tries different separators to split text into chunks of at most chunk_size characters.

This is a Rust port of LangChain’s RecursiveCharacterTextSplitter.

Implementations

impl RecursiveCharacterTextSplitter<CharSizer>

pub fn new(chunk_size: usize, chunk_overlap: usize) -> Self

pub fn builder() -> RecursiveCharacterTextSplitterBuilder<CharSizer>

impl<S> RecursiveCharacterTextSplitter<S>

where S: ChunkSizer,

pub fn split_text(&self, text: &str) -> Vec<String>

pub fn chunks<'a>( &'a self, text: &'a str, ) -> impl Iterator<Item = TextChunk<'a>> + 'a

pub fn split_chunks<'a>(&'a self, text: &'a str) -> Vec<TextChunk<'a>>

Trait Implementations

impl<S: Clone> Clone for RecursiveCharacterTextSplitter<S>

fn clone(&self) -> RecursiveCharacterTextSplitter<S>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.