Skip to main content

LLM_SLOT_POLL_INTERVAL_MS

Constant LLM_SLOT_POLL_INTERVAL_MS 

Source
pub const LLM_SLOT_POLL_INTERVAL_MS: u64 = 100;
Expand description

How long the LLM slot acquirer sleeps between polls while every slot is busy.

Short enough that a freed slot is picked up promptly, long enough that a waiting process does not spin on the lock.