pub trait ModelExecutor: Send + Sync {
// Required method
fn execute(
&self,
request: ModelRequest,
skip_plugin: String,
scope: RequestScope,
) -> BoxFuture<'_, Result<ModelOutput, CallbackError>>;
}Expand description
The server’s model execution boundary (Go HostModelExecutor). The caller is
skipped only by routers and interceptors; other plugins still participate.
Required Methods§
fn execute( &self, request: ModelRequest, skip_plugin: String, scope: RequestScope, ) -> BoxFuture<'_, Result<ModelOutput, CallbackError>>
Dyn Compatibility§
This trait is dyn compatible.
In older versions of Rust, dyn compatibility was called "object safety".