Struct RateLimiter 

pub struct RateLimiter { /* private fields */ }

Token bucket rate limiter for tool calls.

Each tool can have an independent rate limit. When a tool’s bucket is empty, acquire() blocks until a token becomes available (backpressure).

Implementations

impl RateLimiter

pub fn new() -> Self

Create an empty rate limiter with no limits configured.

pub async fn set_limit(&self, tool: &str, limit: RateLimit)

Configure a rate limit for a specific tool.

max_calls tokens over interval_secs seconds. The refill rate is max_calls / interval_secs tokens per second.

pub async fn acquire(&self, tool: &str)

Wait until a token is available for the given tool, then consume it.

If no rate limit is configured for the tool, returns immediately. This provides backpressure: callers block until capacity is available.

pub async fn try_acquire(&self, tool: &str) -> bool

Non-blocking attempt to acquire a token for the given tool.

Returns true if a token was consumed, false if the bucket is empty. Returns true if no rate limit is configured for the tool.

Trait Implementations

impl Default for RateLimiter

fn default() -> Self

Returns the “default value” for a type.