Expand description
Index command implementation
Memory-safe parallel indexing:
- Phase 1: Collect file paths (small memory footprint)
- Phase 2: Parallel read + chunk with rayon (bounded by thread pool)
- Phase 3: Sequential write to Tantivy with periodic commits
- Phase 4: Build semantic trace index (symbols, calls, references)
This avoids holding all file contents or chunks in memory at once.
Functionsยง
- run
- Run the index command