Struct IndexWriter 

pub struct IndexWriter<D: DirectoryWriter> { /* private fields */ }

Async IndexWriter for adding documents and committing segments

Features:

• Streams documents to disk immediately (no in-memory document storage)
• Uses string interning for terms (reduced allocations)
• Uses hashbrown HashMap (faster than BTreeMap)
• Spills large posting lists to disk (bounded memory)
• Uses memory-mapped files for intermediate data

Implementations

impl<D: DirectoryWriter> IndexWriter<D>

pub async fn create( directory: D, schema: Schema, config: IndexConfig, ) -> Result<Self>

Create a new index in the directory

pub async fn create_with_config( directory: D, schema: Schema, config: IndexConfig, builder_config: SegmentBuilderConfig, ) -> Result<Self>

Create a new index with custom builder config

pub async fn open(directory: D, config: IndexConfig) -> Result<Self>

Open an existing index for writing

pub async fn open_with_config( directory: D, config: IndexConfig, builder_config: SegmentBuilderConfig, ) -> Result<Self>

Open an existing index with custom builder config

pub fn schema(&self) -> &Schema

Get the schema

pub fn set_tokenizer<T: Tokenizer>(&mut self, field: Field, tokenizer: T)

Set tokenizer for a field

pub async fn add_document(&self, doc: Document) -> Result<DocId>

Add a document

Documents are streamed to disk immediately, keeping memory usage bounded. When the builder reaches max_docs_per_segment, it is committed and a new one starts.

pub async fn get_builder_stats(&self) -> Option<SegmentBuilderStats>

Get current builder statistics for debugging

pub async fn commit(&self) -> Result<()>

Commit all pending segments to disk

pub async fn force_merge(&self) -> Result<()>

Force merge all segments into one