Skip to main content

TextSplitter

synaptic_splitters

Trait TextSplitter 

Source 
pub trait TextSplitter: Send + Sync {
    // Required method
    fn split_text(&self, text: &str) -> Vec<String>;

    // Provided method
    fn split_documents(&self, docs: Vec<Document>) -> Vec<Document> { ... }
}
Expand description

Trait for splitting text into chunks.

Required Methods§

Source

fn split_text(&self, text: &str) -> Vec<String>

Split a string into chunks.

Provided Methods§

Source

fn split_documents(&self, docs: Vec<Document>) -> Vec<Document>

Split documents by splitting each document’s content and producing new documents for each chunk. Metadata is preserved on each chunk.

Implementors§