Skip to main content

ServingController

Trait ServingController 

Source
pub trait ServingController: Send + Sync {
    // Required methods
    fn load<'a>(
        &'a self,
        request: LoadModelRequest,
    ) -> ServingFuture<'a, ServedModel>;
    fn unload<'a>(
        &'a self,
        request: UnloadModelRequest,
    ) -> ServingFuture<'a, ()>;
    fn served_models<'a>(&'a self) -> ServingFuture<'a, Vec<ServedModel>>;
    fn status<'a>(&'a self) -> ServingFuture<'a, ServingStatus>;
    fn set_device_policy<'a>(
        &'a self,
        policy: DevicePolicy,
    ) -> ServingFuture<'a, ()>;
}

Required Methods§

Source

fn load<'a>( &'a self, request: LoadModelRequest, ) -> ServingFuture<'a, ServedModel>

Source

fn unload<'a>(&'a self, request: UnloadModelRequest) -> ServingFuture<'a, ()>

Source

fn served_models<'a>(&'a self) -> ServingFuture<'a, Vec<ServedModel>>

Source

fn status<'a>(&'a self) -> ServingFuture<'a, ServingStatus>

Source

fn set_device_policy<'a>( &'a self, policy: DevicePolicy, ) -> ServingFuture<'a, ()>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§