Skip to main content

Module models

Module models 

Source
Expand description

Startup of the search indexes and the embedding and rerank models, and the timers that unload idle models.

Structs§

IndexHandles
The reader is what AppState and every recall call see; the writer is private to the drain loop. Splitting them means recall never contends with the drain loop for anything heavier than the brief reload_view call the loop makes on the reader after each successful drain.

Functions§

load_embedder
load_reranker
open_index_handles
on_rebuild hears how many memories a rebuild covers before it starts.
spawn_idle_unload
Must run inside the tokio runtime.