Skip to main content

Module builder

Module builder 

Source
Expand description

VectorIndexBuilder for constructing vector search indices.

The builder orchestrates content discovery, text extraction, batch embedding, and index population:

  1. Discover content files using glob patterns
  2. Parse frontmatter and content
  3. Call VectorExtractor to produce VectorDocuments
  4. Batch embed documents via EmbeddingProvider
  5. Insert into VectorBackend

§Two-Phase Build

  • Phase 1: Discover + extract all documents (sync, CPU-bound)
  • Phase 2: Batch embed + insert (async, may be I/O-bound)

Structs§

VectorIndexBuilder
Builder for constructing vector search indices.

Enums§

ErrorHandling
Options for handling errors during vector index building.

Functions§

compute_content_hash
Compute a content hash for freshness checking.