Struct LLMMiddlewareStack 

pub struct LLMMiddlewareStack { /* private fields */ }

Stack of middlewares to execute in order.

Implementations

impl LLMMiddlewareStack

pub fn new() -> Self

Create a new empty middleware stack.

pub fn add(&mut self, middleware: Arc<dyn LLMMiddleware>)

Add a middleware to the stack.

pub fn len(&self) -> usize

Get the number of middlewares.

pub fn is_empty(&self) -> bool

Check if the stack is empty.

pub async fn before(&self, request: &LLMRequest) -> Result<()>

Execute all before hooks in registration order.

pub async fn after( &self, request: &LLMRequest, response: &LLMResponse, duration_ms: u64, ) -> Result<()>

Execute all after hooks in reverse order.

Trait Implementations

impl Default for LLMMiddlewareStack

fn default() -> LLMMiddlewareStack

Returns the “default value” for a type.