Module segment

Module segment 

Source

Structs§

AsyncSegmentReader
Async segment reader with lazy loading
AsyncStoreReader
Async document store reader - loads blocks on demand
FieldStats
Field statistics for BM25F scoring
ParallelStoreWriter
Parallel document store writer - compresses blocks in parallel while maintaining order
RawStoreBlock
Raw block info for store merging (without decompression)
SegmentBuilder
Builder for creating a single segment
SegmentFiles
Paths for segment files
SegmentId
Unique segment identifier (UUID7-like: 48-bit timestamp + 80-bit random)
SegmentMerger
Segment merger - merges multiple segments into one
SegmentMeta
Segment metadata
StoreMerger
Store merger - concatenates compressed blocks from multiple stores without recompression
StoreWriter
Document store writer with optional dictionary compression

Constants§

DEFAULT_DICT_SIZE
Default dictionary size (64KB is a good balance)
STORE_BLOCK_SIZE
Block size for document store (256KB for better compression) Larger blocks = better compression ratio but more memory per block load

Functions§

delete_segment
Delete segment files from directory

Type Aliases§

SegmentReader
Alias for AsyncSegmentReader