Struct RateLimit 

pub struct RateLimit { /* private fields */ }

Provider produced by RateLimitLayer.

Trait Implementations

impl LlmProvider for RateLimit

fn chat<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, RateLimit: 'async_trait,

Single-shot chat completion.

fn chat_stream<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<StreamDelta, LlmError>> + Send>>, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, RateLimit: 'async_trait,

Streaming chat completion.

fn embed<'life0, 'async_trait>( &'life0 self, req: EmbedRequest, ) -> Pin<Box<dyn Future<Output = Result<EmbedResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, RateLimit: 'async_trait,

Generate embeddings.

fn name(&self) -> &'static str

Provider name (“openai” | “anthropic” | “ollama”).

fn model(&self) -> &str

Active default model slug.

fn estimate_cost(&self, req: &ChatRequest) -> Option<CostEstimate>

Pre-flight cost estimate (no network call). None if unknown.