Struct RateLimiter 

pub struct RateLimiter { /* private fields */ }

Rate limiter for controlling API call frequency and concurrency

Provides dual-level throttling: semaphore-based concurrency control and time-based rate limiting for both LLM and embedding API calls.

Implementations

impl RateLimiter

pub fn new(config: &AsyncConfig) -> Self

Creates a new rate limiter from configuration

Initializes semaphores and rate trackers for both LLM and embedding API calls.

Parameters

• config: Configuration specifying concurrency and rate limits

pub async fn acquire_llm_permit( &self, ) -> Result<SemaphorePermit<'_>, GraphRAGError>

Acquires a permit for making an LLM API call

Blocks until both concurrency and rate limits allow the call to proceed. The permit must be held for the duration of the API call and will be released when dropped.

Returns

Semaphore permit on success, or an error if acquisition fails

pub async fn acquire_embedding_permit( &self, ) -> Result<SemaphorePermit<'_>, GraphRAGError>

Acquires a permit for making an embedding API call

Blocks until both concurrency and rate limits allow the call to proceed. The permit must be held for the duration of the API call and will be released when dropped.

Returns

Semaphore permit on success, or an error if acquisition fails

pub fn get_available_llm_permits(&self) -> usize

Returns the number of available LLM permits

Returns

Number of LLM API calls that can be made immediately without waiting

pub fn get_available_embedding_permits(&self) -> usize

Returns the number of available embedding permits

Returns

Number of embedding API calls that can be made immediately without waiting

pub fn health_check(&self) -> ComponentStatus

Performs a health check on the rate limiter

Checks permit availability to determine if the system is healthy or experiencing congestion.

Returns

Component status indicating health (Healthy, Warning, or Error)

pub fn get_config(&self) -> &AsyncConfig

Returns the current configuration

Returns

Reference to the async processing configuration

Trait Implementations

impl Debug for RateLimiter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.