Module segment

Structs§

AsyncSegmentReader: Async segment reader with lazy loading
AsyncStoreReader: Async document store reader - loads blocks on demand
EagerParallelStoreWriter: Parallel document store writer - compresses blocks immediately when queued
FieldStats: Field statistics for BM25F scoring
MemoryBreakdown: Detailed memory breakdown by component
MergeStats: Statistics for merge operations
RawStoreBlock: Raw block info for store merging (without decompression)
SegmentBuilder: Segment builder with optimized memory usage
SegmentBuilderConfig: Configuration for segment builder
SegmentBuilderStats: Statistics for debugging segment builder performance
SegmentFiles: Paths for segment files
SegmentId: Unique segment identifier (UUID7-like: 48-bit timestamp + 80-bit random)
SegmentMerger: Segment merger - merges multiple segments into one
SegmentMeta: Segment metadata
SparseIndex: Sparse vector index for a field: direct-indexed by dimension ID
StoreMerger: Store merger - concatenates compressed blocks from multiple stores without recompression

DEFAULT_DICT_SIZE: Default dictionary size (64KB is a good balance)
STORE_BLOCK_SIZE: Block size for document store (256KB for better compression) Larger blocks = better compression ratio but more memory per block load