Structs§
- Async
Segment Reader - Async segment reader with lazy loading
- Async
Store Reader - Async document store reader - loads blocks on demand
- Eager
Parallel Store Writer - Parallel document store writer - compresses blocks immediately when queued
- Field
Stats - Field statistics for BM25F scoring
- RawStore
Block - Raw block info for store merging (without decompression)
- Segment
Builder - Segment builder with optimized memory usage
- Segment
Builder Config - Configuration for segment builder
- Segment
Builder Stats - Statistics for debugging segment builder performance
- Segment
Files - Paths for segment files
- Segment
Id - Unique segment identifier (UUID7-like: 48-bit timestamp + 80-bit random)
- Segment
Merger - Segment merger - merges multiple segments into one
- Segment
Meta - Segment metadata
- Store
Merger - Store merger - concatenates compressed blocks from multiple stores without recompression
- Store
Writer - Document store writer with optional dictionary compression
Constants§
- DEFAULT_
DICT_ SIZE - Default dictionary size (64KB is a good balance)
- STORE_
BLOCK_ SIZE - Block size for document store (256KB for better compression) Larger blocks = better compression ratio but more memory per block load
Functions§
- delete_
segment - Delete segment files from directory
- deserialize_
document - serialize_
document
Type Aliases§
- Segment
Reader - Alias for AsyncSegmentReader