Module segment_compaction 

Drift-Resilient Segment & Compaction Strategy (Task 9)

Provides immutable segment management with:

• Quantizer error tracking and threshold-based retraining
• Segment lifecycle governance
• Atomic version transitions

Philosophy

1. Segments are immutable once written
2. Deletes accumulate in tombstone bitvec
3. Compaction merges small segments, removes tombstones
4. Quantizer is retrained when drift exceeds threshold

Usage

use sochdb_vector::segment_compaction::{SegmentManager, CompactionPolicy, Segment};

let manager = SegmentManager::new(policy);
manager.add_segment(segment);
manager.maybe_compact();

Structs

CompactionJob

Compaction job

CompactionPlanner

Plans compaction jobs

CompactionPolicy

Compaction trigger conditions

ManagerStats

Manager statistics

QuantizerMeta

Quantizer metadata

Segment

Immutable segment

SegmentId

Unique segment identifier

SegmentManager

Manages segment lifecycle

SegmentStats

Segment statistics for compaction decisions

VersionManager

Manages segment versions for atomic transitions

Enums

CompactionDecision

Compaction decision for a set of segments

CompactionError

Compaction error

SegmentState

Segment state