Struct Limiter 

pub struct Limiter { /* private fields */ }

A bounded concurrency limiter.

Cheap to clone (the semaphore is wrapped in an Arc); typically built once per process and shared across the analyzer.

Implementations

impl Limiter

pub fn new(max_concurrent: usize) -> Self

Build a limiter that allows at most max_concurrent in-flight requests. max_concurrent = 0 is allowed by the type system but makes every acquire await forever; callers are expected to set a positive value from LlmConfig::max_concurrent (default 3).

pub async fn acquire(&self) -> LimiterGuard<'_>

Acquire a slot. The slot is held until the returned guard is dropped.

Backpressure is the entire job: callers await, and once K requests are in flight, the next one queues here until one of the holders drops its guard.

pub fn available(&self) -> usize

The number of slots currently available for acquisition.

Reflects the configured maximum before any acquisition, decreases by one per held guard, and returns to the maximum once every guard has been dropped. Test-only - exposed via the API so tests can pin the behaviour without reaching into the semaphore.

Trait Implementations

impl Clone for Limiter

fn clone(&self) -> Limiter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Limiter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.