Struct ProviderMiddleware 

pub struct ProviderMiddleware {
    pub language_model: Vec<Arc<dyn LanguageModelMiddleware>>,
    pub embedding_model: Vec<Arc<dyn EmbeddingModelMiddleware>>,
    pub image_model: Vec<Arc<dyn ImageModelMiddleware>>,
}

Middleware applied by wrap_provider to the models a provider resolves.

Each list is applied in order (first outermost) to every model of its kind; models of other kinds and provider services pass through.

Fields

language_model: Vec<Arc<dyn LanguageModelMiddleware>>

Applied to every language model.

embedding_model: Vec<Arc<dyn EmbeddingModelMiddleware>>

Applied to every embedding model.

image_model: Vec<Arc<dyn ImageModelMiddleware>>

Applied to every image model.

Implementations

impl ProviderMiddleware

pub fn new() -> Self

Creates an empty set.

pub fn language_model( self, middleware: Arc<dyn LanguageModelMiddleware>, ) -> Self

Appends a language model middleware.

pub fn embedding_model( self, middleware: Arc<dyn EmbeddingModelMiddleware>, ) -> Self

Appends an embedding model middleware.

pub fn image_model(self, middleware: Arc<dyn ImageModelMiddleware>) -> Self

Appends an image model middleware.

pub fn is_empty(&self) -> bool

Returns true when no middleware is configured.

Trait Implementations

impl Clone for ProviderMiddleware

fn clone(&self) -> ProviderMiddleware

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderMiddleware

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ProviderMiddleware

fn default() -> ProviderMiddleware

Returns the “default value” for a type.