Struct CapabilityMiddleware 

pub struct CapabilityMiddleware<C> { /* private fields */ }

Middleware created by capability_middleware.

Implementations

impl<C> CapabilityMiddleware<C>

pub fn to_input( self, f: impl Fn(&CallOptions, &MiddlewareContext<'_>) -> JsonValue + Send + Sync + 'static, ) -> Self

Replaces the default input document.

pub fn on_error(self, mode: FailureMode) -> Self

Sets the behaviour on evaluation errors (default: remove all tools).

pub fn path(&self) -> &str

The policy path.

Trait Implementations

impl<C> Debug for CapabilityMiddleware<C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<C: PolicyClient> LanguageModelMiddleware for CapabilityMiddleware<C>

fn transform_params<'a>( &'a self, options: CallOptions, ctx: MiddlewareContext<'a>, ) -> BoxFuture<'a, Result<CallOptions, ProviderError>>

Rewrites the call options before the call.

fn wrap_generate<'a>( &'a self, options: CallOptions, next: Box<dyn FnOnce(CallOptions) -> Pin<Box<dyn Future<Output = Result<GenerateResult, ProviderError>> + Send + 'a>> + Send + 'a>, _ctx: MiddlewareContext<'a>, ) -> Pin<Box<dyn Future<Output = Result<GenerateResult, ProviderError>> + Send + 'a>>

Wraps do_generate.

fn wrap_stream<'a>( &'a self, options: CallOptions, next: Box<dyn FnOnce(CallOptions) -> Pin<Box<dyn Future<Output = Result<StreamResult, ProviderError>> + Send + 'a>> + Send + 'a>, _ctx: MiddlewareContext<'a>, ) -> Pin<Box<dyn Future<Output = Result<StreamResult, ProviderError>> + Send + 'a>>

Wraps do_stream.

fn override_provider( &self, _model: &(dyn DynLanguageModel + 'static), ) -> Option<ProviderId>

Overrides the provider id reported by the wrapped model.

fn override_model_id( &self, _model: &(dyn DynLanguageModel + 'static), ) -> Option<ModelId>

Overrides the model id reported by the wrapped model.

fn override_supported_urls<'a>( &'a self, _model: &'a (dyn DynLanguageModel + 'static), ) -> Option<Pin<Box<dyn Future<Output = SupportedUrls> + Send + 'a>>>

Overrides the supported URLs of the wrapped model.