Struct StreamMiddleware 

pub struct StreamMiddleware { /* private fields */ }

Intercepts the output stream from a wrapped StreamFn.

The inner StreamFn is called normally, then map_stream transforms the resulting event stream before it reaches the consumer.

Implementations

impl StreamMiddleware

pub fn new<F>(inner: Arc<dyn StreamFn>, f: F) -> Self

where F: for<'a> Fn(Pin<Box<dyn Stream<Item = AssistantMessageEvent> + Send + 'a>>) -> Pin<Box<dyn Stream<Item = AssistantMessageEvent> + Send + 'a>> + Send + Sync + 'static,

Create a new middleware with a full stream transformation.

The closure receives the inner stream and returns a transformed stream.

pub fn with_logging<F>(inner: Arc<dyn StreamFn>, callback: F) -> Self

where F: Fn(&AssistantMessageEvent) + Send + Sync + 'static,

Create a middleware that inspects each event via a logging callback.

Events pass through unmodified; the callback is called for each event.

pub fn with_map<F>(inner: Arc<dyn StreamFn>, f: F) -> Self

where F: Fn(AssistantMessageEvent) -> AssistantMessageEvent + Send + Sync + 'static,

Create a middleware that maps each event through a transformation.

pub fn with_filter<F>(inner: Arc<dyn StreamFn>, f: F) -> Self

where F: Fn(&AssistantMessageEvent) -> bool + Send + Sync + 'static,

Create a middleware that filters events based on a predicate.

Events for which the predicate returns false are dropped from the stream.

Trait Implementations

impl Debug for StreamMiddleware

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl StreamFn for StreamMiddleware

fn stream<'a>( &'a self, model: &'a ModelSpec, context: &'a AgentContext, options: &'a StreamOptions, cancellation_token: CancellationToken, ) -> Pin<Box<dyn Stream<Item = AssistantMessageEvent> + Send + 'a>>

Initiate a streaming LLM call.