Skip to main content

TextSplitter

synaptic_splitters

Trait TextSplitter 

Source 
pub trait TextSplitter: Send + Sync {
    // Required method
    fn split_text(&self, text: &str) -> Vec<String>;

    // Provided method
    fn split_documents(&self, docs: Vec<Document>) -> Vec<Document> { ... }
}
Expand description

Trait for splitting text into chunks.

Required Methods§

Source

fn split_text(&self, text: &str) -> Vec<String>

Split a string into chunks.

Provided Methods§

Source

fn split_documents(&self, docs: Vec<Document>) -> Vec<Document>

Split documents by splitting each document’s content and producing new documents for each chunk. Metadata is preserved on each chunk.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§