pub struct CudaTensorExecutor { /* private fields */ }Expand description
Tensor executor backed by validated CUDA/cuBLAS ABI evidence.
Implementations§
Source§impl CudaTensorExecutor
impl CudaTensorExecutor
Sourcepub fn new(evidence: CudaAbiEvidence) -> Self
pub fn new(evidence: CudaAbiEvidence) -> Self
Builds an executor from validated CUDA ABI evidence.
Sourcepub fn from_runtime(runtime: Arc<CudaLibrarySet>) -> Self
pub fn from_runtime(runtime: Arc<CudaLibrarySet>) -> Self
Builds an executor that submits f32 matmul to a validated CUDA runtime.
Sourcepub fn evidence(&self) -> &CudaAbiEvidence
pub fn evidence(&self) -> &CudaAbiEvidence
Returns the CUDA ABI evidence used by this executor.
Trait Implementations§
Source§impl Clone for CudaTensorExecutor
impl Clone for CudaTensorExecutor
Source§fn clone(&self) -> CudaTensorExecutor
fn clone(&self) -> CudaTensorExecutor
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl TensorExecutor for CudaTensorExecutor
impl TensorExecutor for CudaTensorExecutor
Source§fn card(&self) -> TensorExecutorCard
fn card(&self) -> TensorExecutorCard
Returns the executor descriptor.
Source§fn execute(
&self,
cx: &mut Cx,
request: TensorRequest,
) -> Result<TensorExecution, TensorExecError>
fn execute( &self, cx: &mut Cx, request: TensorRequest, ) -> Result<TensorExecution, TensorExecError>
Executes one checked tensor request.
Source§fn flush(&self) -> Result<SubmissionEvidence, TensorExecError>
fn flush(&self) -> Result<SubmissionEvidence, TensorExecError>
Flushes accepted submissions and returns synchronization evidence.
Auto Trait Implementations§
impl Freeze for CudaTensorExecutor
impl RefUnwindSafe for CudaTensorExecutor
impl Send for CudaTensorExecutor
impl Sync for CudaTensorExecutor
impl Unpin for CudaTensorExecutor
impl UnsafeUnpin for CudaTensorExecutor
impl UnwindSafe for CudaTensorExecutor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more