Struct ort::NNAPIExecutionProvider

pub struct NNAPIExecutionProvider { /* private fields */ }

Implementations

impl NNAPIExecutionProvider

pub fn with_fp16(self) -> Self

Use fp16 relaxation in NNAPI EP. This may improve performance but can also reduce accuracy due to the lower precision.

pub fn with_nchw(self) -> Self

Use the NCHW layout in NNAPI EP. This is only available for Android API level 29 and higher. Please note that for now, NNAPI might have worse performance using NCHW compared to using NHWC.

pub fn with_disable_cpu(self) -> Self

Prevents NNAPI from using CPU devices. NNAPI is more efficient using GPU or NPU for execution, and NNAPI might fall back to its own CPU implementation for operations not supported by the GPU/NPU. However, the CPU implementation of NNAPI might be less efficient than the optimized versions of operators provided by ORT’s default MLAS execution provider. It might be better to disable the NNAPI CPU fallback and instead use MLAS kernels. This option is only available after Android API level 29.

pub fn with_cpu_only(self) -> Self

Using CPU only in NNAPI EP, this may decrease the perf but will provide reference output value without precision loss, which is useful for validation. This option is only available for Android API level 29 and higher, and will be ignored for Android API level 28 and lower.

pub fn build(self) -> ExecutionProviderDispatch

Trait Implementations

impl Clone for NNAPIExecutionProvider

fn clone(&self) -> NNAPIExecutionProvider

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for NNAPIExecutionProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for NNAPIExecutionProvider

fn default() -> NNAPIExecutionProvider

Returns the “default value” for a type.

impl ExecutionProvider for NNAPIExecutionProvider

fn as_str(&self) -> &'static str

Returns the identifier of this execution provider used internally by ONNX Runtime.

fn supported_by_platform(&self) -> bool

Returns whether this execution provider is supported on this platform.

fn register(&self, session_builder: &SessionBuilder) -> Result<()>

Attempts to register this execution provider on the given session.

fn is_available(&self) -> Result<bool>

Returns Ok(true) if ONNX Runtime was compiled with support for this execution provider, and Ok(false) otherwise.

impl From<NNAPIExecutionProvider> for ExecutionProviderDispatch

fn from(value: NNAPIExecutionProvider) -> Self

Converts to this type from the input type.