Skip to main content

Module segment

Module segment 

Source

Structs§

AsyncSegmentReader
Async segment reader with lazy loading
AsyncStoreReader
Async document store reader - loads blocks on demand
EagerParallelStoreWriter
Parallel document store writer - compresses blocks immediately when queued
FieldStats
Field statistics for BM25F scoring
FlatVectorData
Flat vector data for brute-force search (accumulating state)
IVFRaBitQIndexData
IVF-RaBitQ index data with embedded centroids and codebook
MemoryBreakdown
Detailed memory breakdown by component
MergeStats
Statistics for merge operations
RawStoreBlock
Raw block info for store merging (without decompression)
ScaNNIndexData
ScaNN index data with embedded centroids and codebook
SegmentBuilder
Segment builder with optimized memory usage
SegmentBuilderConfig
Configuration for segment builder
SegmentBuilderStats
Statistics about segment builder state
SegmentFiles
Paths for segment files
SegmentId
Unique segment identifier (UUID7-like: 48-bit timestamp + 80-bit random)
SegmentMerger
Segment merger - merges multiple segments into one
SegmentMeta
Segment metadata
SegmentSnapshot
RAII guard that holds references to a snapshot of segments When dropped, releases all segment references
SegmentTracker
Tracks segment references and pending deletions
SparseIndex
Sparse vector index for a field: direct-indexed by dimension ID
StoreMerger
Store merger - concatenates compressed blocks from multiple stores without recompression
TrainedVectorStructures
Trained vector index structures for rebuilding segments with ANN indexes
VectorSearchResult
Vector search result with ordinal tracking for multi-value fields

Enums§

VectorIndex
Vector index type - Flat, RaBitQ, IVF-RaBitQ, or ScaNN (IVF-PQ)

Constants§

DEFAULT_DICT_SIZE
Default dictionary size (64KB is a good balance)
STORE_BLOCK_SIZE
Block size for document store (256KB for better compression) Larger blocks = better compression ratio but more memory per block load

Functions§

delete_segment
Delete segment files from directory
deserialize_document
serialize_document

Type Aliases§

SegmentReader
Alias for AsyncSegmentReader