Module index

Module index 

Source
Expand description

Index command implementation

Memory-safe parallel indexing:

  • Phase 1: Collect file paths (small memory footprint)
  • Phase 2: Parallel read + chunk with rayon (bounded by thread pool)
  • Phase 3: Sequential write to Tantivy with periodic commits
  • Phase 4: Build semantic trace index (symbols, calls, references)

This avoids holding all file contents or chunks in memory at once.

Functionsยง

run
Run the index command