Skip to main content

ModelExecutor

Trait ModelExecutor 

Source
pub trait ModelExecutor: Send + Sync {
    // Required method
    fn execute(
        &self,
        request: ModelRequest,
        skip_plugin: String,
        scope: RequestScope,
    ) -> BoxFuture<'_, Result<ModelOutput, CallbackError>>;
}
Expand description

The server’s model execution boundary (Go HostModelExecutor). The caller is skipped only by routers and interceptors; other plugins still participate.

Required Methods§

Source

fn execute( &self, request: ModelRequest, skip_plugin: String, scope: RequestScope, ) -> BoxFuture<'_, Result<ModelOutput, CallbackError>>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§