Struct MarkdownChunker 

pub struct MarkdownChunker { /* private fields */ }

Available on crate feature rag only.

Splits text by markdown headers, keeping each section as a chunk.

Each section is prefixed with its header hierarchy. Sections exceeding chunk_size are further split using RecursiveChunker logic. The header_path metadata field records the header hierarchy for each chunk.

Example

use adk_rag::MarkdownChunker;

let chunker = MarkdownChunker::new(512, 100);
let chunks = chunker.chunk(&document);

Implementations

impl MarkdownChunker

pub fn new(chunk_size: usize, chunk_overlap: usize) -> MarkdownChunker

Create a new MarkdownChunker.

Arguments

• chunk_size — maximum number of characters per chunk
• chunk_overlap — number of overlapping characters between consecutive chunks

Trait Implementations

impl Chunker for MarkdownChunker

fn chunk(&self, document: &Document) -> Vec<Chunk>

Split a document into chunks.

impl Clone for MarkdownChunker

fn clone(&self) -> MarkdownChunker

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MarkdownChunker

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.