Struct IpcServer 

pub struct IpcServer { /* private fields */ }

Implementations

impl IpcServer

pub fn new( socket_path: &str, schedulers: HashMap<u32, Arc<dyn ReplicaScheduler + Send + Sync>>, shm_manager: Option<Arc<ShmManager>>, ) -> Self

pub fn new_with_lookup( socket_path: &str, scheduler_lookup: SchedulerLookup, shm_manager: Option<Arc<ShmManager>>, ) -> Self

pub fn with_auth_token(self, token: impl Into<String>) -> Self

Require every inference request to carry this token in request.metadata.auth_token. Requests without the token or with a wrong token receive STATUS_ERR: Unauthorized.

Trait Implementations

impl TransportServer for IpcServer

fn run<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<(), TransportError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Start the transport server This should block until the server is shut down

fn shutdown<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<(), TransportError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Gracefully shutdown the server

fn transport_type(&self) -> &'static str

Get the transport type name (for logging/debugging)