Struct AutoTensorExecutor 

pub struct AutoTensorExecutor { /* private fields */ }

Tensor executor that picks the best compatible provider and falls back to CPU.

Implementations

impl AutoTensorExecutor

pub fn new(profile: AutoComputeProfile) -> Self

Builds an automatic executor from a profile.

pub fn uses_cpu_fallback(&self) -> bool

Returns true when the selector is using the CPU fallback.

pub fn route_decision(&self) -> AutoRouteDecision

Returns the router decision that produced this executor.

pub fn routing_events(&self) -> Vec<AutoRoutingEvent>

Returns routing ledger events recorded by execute and flush calls.

Trait Implementations

impl Clone for AutoTensorExecutor

fn clone(&self) -> AutoTensorExecutor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for AutoTensorExecutor

fn default() -> Self

Returns the “default value” for a type.

impl TensorExecutor for AutoTensorExecutor

fn card(&self) -> TensorExecutorCard

Returns the executor descriptor.

fn execute( &self, cx: &mut Cx, request: TensorRequest, ) -> Result<TensorExecution, TensorExecError>

Executes one checked tensor request.

fn flush(&self) -> Result<SubmissionEvidence, TensorExecError>

Flushes accepted submissions and returns synchronization evidence.