Module index 

Tantivy-based indexing tool for AGCodex

This module provides a comprehensive search indexing system using Tantivy for fast, sophisticated codebase search. The IndexTool supports:

• Full-text search with language-aware analysis
• Symbol-based semantic search (functions, classes, variables)
• Incremental updates for efficient re-indexing
• Location-aware results with precise file:line:column metadata
• Multi-language support via tree-sitter integration

Architecture

┌─────────────────┐    ┌─────────────────┐    ┌─────────────────┐
│   IndexTool     │───▶│  Tantivy Index  │───▶│  Search Results │
│                 │    │                 │    │                 │
│ • build()       │    │ Schema:         │    │ • path          │
│ • update()      │    │ • path          │    │ • content       │
│ • optimize()    │    │ • content       │    │ • symbols       │
│ • stats()       │    │ • symbols       │    │ • language      │
│ • search()      │    │ • language      │    │ • location      │
└─────────────────┘    └─────────────────┘    └─────────────────┘

Structs

BuildInput

Input for build operation

IndexConfig

Configuration for the indexing tool

IndexStats

Statistics about the index

IndexTool

Main indexing tool implementation

IndexedDocument

Document in the search index

MergePolicyConfig

Merge policy configuration

SearchInput

Input for search operation

SearchQuery

Search query parameters

SearchResult

Search result from the index with compression support

Symbol

Symbol information extracted from code

UpdateInput

Input for update operation

Enums

IndexError

Errors specific to the indexing tool

Type Aliases

IndexResult

Result type for index operations