Struct MarkdownHeaderTextSplitter 

pub struct MarkdownHeaderTextSplitter { /* private fields */ }

Splits markdown text by headers, adding header hierarchy to metadata.

Each section between headers becomes a separate document.

Implementations

impl MarkdownHeaderTextSplitter

pub fn new(headers_to_split_on: Vec<HeaderType>) -> Self

pub fn default_headers() -> Self

Default configuration: split on #, ##, ###.

pub fn split_markdown(&self, text: &str) -> Vec<Document>

Split markdown and return documents with header metadata.

Trait Implementations

impl TextSplitter for MarkdownHeaderTextSplitter

fn split_text(&self, text: &str) -> Vec<String>

Split a string into chunks.

fn split_documents(&self, docs: Vec<Document>) -> Vec<Document>

Split documents by splitting each document’s content and producing new documents for each chunk. Metadata is preserved on each chunk.