Skip to main content

MAX_CONCURRENT_CLI_INSTANCES

Constant MAX_CONCURRENT_CLI_INSTANCES 

Source
pub const MAX_CONCURRENT_CLI_INSTANCES: usize = 4;
Expand description

Maximum number of CLI instances running simultaneously.

Aligned with DAEMON_MAX_CONCURRENT_CLIENTS from the PRD. Limits the counting semaphore in crate::lock to prevent memory overload when multiple parallel invocations attempt to load the ONNX model simultaneously.