Skip to main content

Module chunk

Module chunk 

Source
Expand description

Chunk representation for RLM-RS.

Chunks are segments of buffer content created by chunking strategies. Each chunk maintains its position within the original buffer and metadata for tracking and processing.

Structs§

Chunk
Represents a chunk of text from a buffer.
ChunkBuilder
Builder for creating chunks with fluent API.
ChunkMetadata
Metadata associated with a chunk.

Functions§

estimate_tokens_for_text
Estimates token count for a text string with improved accuracy.