pub enum Backend {
TensorRt,
Cuda,
Cpu,
Custom {
name: String,
provider: ExecutionProviderDispatch,
},
}Expand description
An installed ONNX Runtime execution provider.
Variants§
TensorRt
NVIDIA TensorRT execution provider.
Cuda
NVIDIA CUDA execution provider.
Cpu
ONNX Runtime’s CPU execution provider.
Custom
Configure an additional ORT provider without adding its native dependencies. CUDA/TensorRT dispatches are rejected: use the built-in variants and typed options so the engine can own streams and coordinate graph capture. Custom implementations must not register CUDA/TensorRT indirectly.
Fields
§
provider: ExecutionProviderDispatchConfigured provider to register with ONNX Runtime.
Implementations§
Trait Implementations§
Auto Trait Implementations§
impl !RefUnwindSafe for Backend
impl !UnwindSafe for Backend
impl Freeze for Backend
impl Send for Backend
impl Sync for Backend
impl Unpin for Backend
impl UnsafeUnpin for Backend
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more