Module chunking 

Text chunking utilities for memory content processing.

Splits text into overlapping chunks for embedding generation. Supports both fixed-size and semantic (paragraph-based) chunking.

Structs

ChunkConfig

Configuration for text chunking.

TextChunk

A text chunk with metadata.

Functions

chunk_fixed

Split text into fixed-size overlapping chunks.

chunk_paragraphs

Split text into paragraphs, then group paragraphs into chunks that don’t exceed max_chunk_size.