Expand description
Document indexing pipeline for the RAG system
This module handles parsing and chunking of various document formats for indexing into the vector database.
Structs§
- Indexer
- Document indexer for the RAG system
Functions§
- find_
documents - Find all indexable documents in a directory using WalkDir for performance
- index_
document - Index a single document and return chunks
- is_
supported_ file - Check if a file is supported for indexing