Expand description
Semantic Chunking
This module provides intelligent text chunking strategies that respect:
- Sentence boundaries
- Paragraph structure
- Topic coherence
- Semantic similarity
§Chunking Strategies
- Sentence-based: Chunks at sentence boundaries
- Paragraph-based: Chunks at paragraph breaks
- Topic-based: Chunks when topic shifts detected
- Semantic: Chunks based on embedding similarity
- Hybrid: Combines multiple strategies
Structs§
- Chunking
Config - Chunking configuration
- Chunking
Stats - Chunking statistics
- Semantic
Chunk - Text chunk with metadata
- Semantic
Chunker - Semantic chunker
Enums§
- Chunking
Strategy - Chunking strategy