pub enum IsolationKind {
Shared,
StreamIsolated,
ContextIsolated,
}Expand description
How aggressively a tenant’s GPU work is separated from other tenants’.
The variants mirror the levels exposed by tensor-wasm-mem::isolation::IsolationLevel,
but live here as a separate type so this crate can be consumed without
pulling in the Wasmtime-dependent memory crate.
Variants§
All tenants share the default CUDA context and stream.
Cheap to spawn but unsuitable for multi-tenant untrusted workloads.
StreamIsolated
Each tenant gets its own CUDA stream; contexts are shared.
Default for multi-tenant deployments — prevents kernel-ordering accidents without paying the cost of per-tenant context creation.
ContextIsolated
Each tenant gets its own CUDA context (via MPS when available, or
cuCtxCreate otherwise).
Implementations§
Trait Implementations§
Source§impl Clone for IsolationKind
impl Clone for IsolationKind
Source§fn clone(&self) -> IsolationKind
fn clone(&self) -> IsolationKind
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for IsolationKind
Source§impl Debug for IsolationKind
impl Debug for IsolationKind
Source§impl Default for IsolationKind
impl Default for IsolationKind
Source§fn default() -> IsolationKind
fn default() -> IsolationKind
Returns the “default value” for a type. Read more
Source§impl Display for IsolationKind
impl Display for IsolationKind
impl Eq for IsolationKind
Source§impl Hash for IsolationKind
impl Hash for IsolationKind
Source§impl PartialEq for IsolationKind
impl PartialEq for IsolationKind
Source§fn eq(&self, other: &IsolationKind) -> bool
fn eq(&self, other: &IsolationKind) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for IsolationKind
Auto Trait Implementations§
impl Freeze for IsolationKind
impl RefUnwindSafe for IsolationKind
impl Send for IsolationKind
impl Sync for IsolationKind
impl Unpin for IsolationKind
impl UnsafeUnpin for IsolationKind
impl UnwindSafe for IsolationKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more