Skip to main content

APPEND_EMBEDDINGS_FILE

Constant APPEND_EMBEDDINGS_FILE 

Source
pub const APPEND_EMBEDDINGS_FILE: &str = "append_embeddings.bin";
Expand description

Sidecar holding vectors for memories that are still in the append log.

A stored memory is invisible to the semantic path until the next full rebuild: embeddings.bin is built from the consolidated index, and the append log is addressed by position (1_000_000 + ai). This closes that gap – the store path embeds the text once and records the vector under its append index, and recall scores it next to the main index.

Layout: [4 bytes “AEM1”][u32 dim][u32 record_count] [u32 append_index][f32 x dim] x record_count

Two properties keep it from desynchronising into wrong answers. It is removed wherever append.bin is removed (rebuild, doctor repair), and a record whose append index no longer exists is simply never looked up, so an external edit of the log cannot resurrect a vector for a different memory.