pub struct GpuInferenceEngine { /* private fields */ }Expand description
GPU-backed inference engine.
Routes through layer5 kernel handles with automatic hardware detection:
VendorBackend::detect() selects CUDA → ROCm → Metal → TPTIR fallback.
Trait Implementations§
Source§impl Debug for GpuInferenceEngine
impl Debug for GpuInferenceEngine
Auto Trait Implementations§
impl Freeze for GpuInferenceEngine
impl RefUnwindSafe for GpuInferenceEngine
impl Send for GpuInferenceEngine
impl Sync for GpuInferenceEngine
impl Unpin for GpuInferenceEngine
impl UnsafeUnpin for GpuInferenceEngine
impl UnwindSafe for GpuInferenceEngine
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more