Module middleware_stack 

Middleware stack – composes middlewares over a base LlmProvider.

The stack itself implements LlmProvider, so it can be used anywhere a provider is expected. Middlewares execute outside-in: the last one added via with() wraps all previous ones.

Example

let provider = MiddlewareStack::new(openai)
    .with(TimeoutMiddleware::new(Duration::from_secs(30)))
    .with(RetryMiddleware::new(3, Duration::from_millis(200)));
// Use `provider` as any LlmProvider

Structs

MiddlewareStack

A stack of ProviderMiddleware layers wrapping a base LlmProvider.