Struct MiddlewareStack 

pub struct MiddlewareStack { /* private fields */ }

A stack of ProviderMiddleware layers wrapping a base LlmProvider.

Implements LlmProvider itself, enabling transparent composition. Middlewares execute outside-in: the outermost (last added) runs first.

Implementations

impl MiddlewareStack

pub fn new(base: impl LlmProvider) -> Self

Create a new stack wrapping the given base provider.

pub fn with(self, middleware: impl ProviderMiddleware) -> Self

Add a middleware layer. Returns self for chaining.

Layers execute outside-in: the last added runs first.

Trait Implementations

impl LlmProvider for MiddlewareStack

fn complete( &self, messages: &[Message], tools: &[ToolSchema], ) -> Pin<Box<dyn Future<Output = Result<LlmResponse, PeError>> + Send + '_>>

Non-streaming completion. Returns the full response.

fn stream(&self, messages: &[Message], tools: &[ToolSchema]) -> StreamFuture<'_>

Streaming completion. Yields tokens (and tool call deltas) as they arrive.

fn embed( &self, text: &str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>, PeError>> + Send + '_>>

Embed text into a vector. Used for semantic routing and memory search.

fn provider_name(&self) -> &'static str

Human-readable provider name for logging (“openai”, “anthropic”, “mock”).