Expand description
Startup of the search indexes and the embedding and rerank models, and the timers that unload idle models.
Structs§
- Index
Handles - The reader is what
AppStateand every recall call see; the writer is private to the drain loop. Splitting them means recall never contends with the drain loop for anything heavier than the briefreload_viewcall the loop makes on the reader after each successful drain.
Functions§
- load_
embedder - load_
reranker - open_
index_ handles on_rebuildhears how many memories a rebuild covers before it starts.- spawn_
idle_ unload - Must run inside the tokio runtime.