Skip to main content

Module build

Module build 

Source
Expand description

Extracts text from RAW TEXT layer files, constructs a 9-depth block hierarchy (identity → layers → clusters → items → sentences → tokens → syllables → chars → bytes), and writes the binary output files (microscope.bin, data.bin, meta.bin, merkle.bin, embeddings.bin).

Structs§

RebuildOutcome

Functions§

build
Rebuild the binary index from the raw layer files.
compute_layers_hash
maybe_auto_rebuild
Consolidate the append log automatically when the configured threshold is reached, or immediately when no main index exists yet.
rebuild_pending
Rebuild the main index while holding the same process lock used by stores. The append log is removed only after a successful build.