Struct KeyPool 

pub struct KeyPool { /* private fields */ }

Thread-safe key pool managing multiple API keys across endpoints.

Implementations

impl KeyPool

pub fn new() -> Self

pub async fn register_endpoint(&self, endpoint: &str, env_vars: Vec<String>)

Register keys for an endpoint. Merges with any existing keys. Resolution order: process env → OS keychain (see module docs).

pub async fn lease(&self, endpoint: &str) -> Option<KeyLease>

Lease a key for the given endpoint. Returns None if no keys available.

pub async fn lease_or_env( &self, endpoint: &str, fallback_env: &str, ) -> Option<KeyLease>

Lease a key, falling back to a single env var (or keychain) if the endpoint isn’t registered. This provides backward compatibility with the single-key model and triggers the same env→keychain resolution order as register_endpoint.

pub async fn report_success( &self, endpoint: &str, env_var: &str, latency_ms: u64, input_tokens: u64, output_tokens: u64, )

Report a successful request.

pub async fn report_failure( &self, endpoint: &str, env_var: &str, is_rate_limit: bool, )

Report a failed request.

pub async fn endpoint_stats(&self, endpoint: &str) -> Vec<KeyStats>

Get stats for all keys on an endpoint.

pub async fn all_stats(&self) -> HashMap<String, Vec<KeyStats>>

Get stats for all endpoints.

pub async fn total_keys(&self) -> usize

Total key count across all endpoints.

pub async fn available_keys(&self, endpoint: &str) -> usize

Get the number of available (non-rate-limited) keys for an endpoint.

pub async fn save_stats(&self, path: &Path) -> Result<(), Error>

Save key stats to a JSON file.

pub async fn load_stats(&self, path: &Path) -> Result<usize, Error>

Load key stats from a JSON file.

Trait Implementations

impl Default for KeyPool

fn default() -> Self

Returns the “default value” for a type.