Expand description
Semantic windowing chunker for RAG indexing.
Splits timeline entries into overlapping windows of ~1.5k tokens, suitable for vector embedding and semantic search via memex.
Vibecrafted with AI Agents by VetCoders (c)2026 VetCoders
Structs§
- Chunk
- A single chunk ready for vector indexing.
- Chunk
Metadata Sidecar - Structured metadata sidecar persisted alongside each chunk file.
- Chunker
Config - Configuration for the chunker.
Constants§
Functions§
- chunk_
entries - Chunk timeline entries into semantic windows with overlap.
- chunk_
summary - Summary of chunking results.
- classify_
kind - Classify a set of timeline entries into a canonical
Kind. - estimate_
tokens - Estimate token count from text length.
- format_
chunk_ text - Format entries into chunk text with metadata header.
- is_
decision_ tag - is_
outcome_ tag - is_
result_ line - normalize_
key - parse_
checklist_ task - truncate_
signal_ line - write_
chunks_ to_ dir - Write chunks as individual .txt files to a directory.