Struct StructuralChunker 

pub struct StructuralChunker { /* private fields */ }

Structural chunker that respects document boundaries.

Example

use memvid_core::structure::{StructuralChunker, ChunkingOptions, detect_structure};

let text = "| A | B |\n|---|---|\n| 1 | 2 |\n| 3 | 4 |";
let doc = detect_structure(text);

let chunker = StructuralChunker::new(ChunkingOptions::default());
let result = chunker.chunk(&doc);

// Each chunk preserves table structure
for chunk in result.chunks {
    println!("{}", chunk.text);
}

Implementations

impl StructuralChunker

pub fn new(options: ChunkingOptions) -> Self

Create a new chunker with the given options.

pub fn with_max_chars(max_chars: usize) -> Self

Create a chunker with default options and custom max chars.

pub fn chunk(&self, doc: &StructuredDocument) -> ChunkingResult

Chunk a structured document.

Trait Implementations

impl Default for StructuralChunker

fn default() -> Self

Returns the “default value” for a type.