Skip to main content

EMBED_SLOT_RETRY_DELAY_MS

Constant EMBED_SLOT_RETRY_DELAY_MS 

Source
pub const EMBED_SLOT_RETRY_DELAY_MS: u64 = 750;
Expand description

Pause, in milliseconds, before retrying a query embedding that lost the race for an LLM slot.

Long enough for a sibling invocation to finish and release its slot, short enough to stay inside the query path’s own budget. Contention backoff, not a deadline, so it takes no XDG key.