pub struct Engine { /* private fields */ }Expand description
RAII wrapper around one interpreter and session.
This type deliberately does not implement Send or Sync. The safe runtime
keeps it on the model worker that created it.
Implementations§
Source§impl Engine
impl Engine
Sourcepub fn new(model: &[u8], config: Config) -> Result<Self, NativeError>
pub fn new(model: &[u8], config: Config) -> Result<Self, NativeError>
Create an engine from a model buffer.
Sourcepub fn new_with_cache_file(
model: &[u8],
config: Config,
cache_file: Option<&Path>,
) -> Result<Self, NativeError>
pub fn new_with_cache_file( model: &[u8], config: Config, cache_file: Option<&Path>, ) -> Result<Self, NativeError>
Create an engine with a persistent kernel cache loaded before session creation.
The parent directory must already exist; no cache is used when None.
Sourcepub fn effective_threads(&self) -> Option<usize>
pub fn effective_threads(&self) -> Option<usize>
Actual CPU thread count, or None for GPU sessions.
Sourcepub fn inputs(&self) -> Result<Vec<TensorInfo>, NativeError>
pub fn inputs(&self) -> Result<Vec<TensorInfo>, NativeError>
Inspect all input tensors.
Sourcepub fn outputs(&self) -> Result<Vec<TensorInfo>, NativeError>
pub fn outputs(&self) -> Result<Vec<TensorInfo>, NativeError>
Inspect all output tensors.
Sourcepub fn write_input(
&mut self,
name: &str,
data: &[f32],
) -> Result<(), NativeError>
pub fn write_input( &mut self, name: &str, data: &[f32], ) -> Result<(), NativeError>
Copy a named contiguous f32 input into MNN.
Sourcepub fn write_input_index(
&mut self,
index: usize,
data: &[f32],
) -> Result<(), NativeError>
pub fn write_input_index( &mut self, index: usize, data: &[f32], ) -> Result<(), NativeError>
Copy into a pre-resolved input slot; an invalid index is rejected by the bridge.
Sourcepub fn resize_inputs(
&mut self,
shapes: &[(usize, &[i32])],
) -> Result<(), NativeError>
pub fn resize_inputs( &mut self, shapes: &[(usize, &[i32])], ) -> Result<(), NativeError>
Resize every input in one transaction. Entries are (input_index, shape).
All entries are checked before changing native tensors; native resize
failures leave the session requiring another successful resize.
Sourcepub fn save_cache(&mut self) -> Result<(), NativeError>
pub fn save_cache(&mut self) -> Result<(), NativeError>
Persist kernel tuning data. A model without a configured cache is a no-op.
Sourcepub fn run(&mut self) -> Result<(), NativeError>
pub fn run(&mut self) -> Result<(), NativeError>
Run one inference.
Sourcepub fn read_output(
&mut self,
name: &str,
data: &mut [f32],
) -> Result<(), NativeError>
pub fn read_output( &mut self, name: &str, data: &mut [f32], ) -> Result<(), NativeError>
Copy a named contiguous f32 output from MNN.
Sourcepub fn read_output_index(
&mut self,
index: usize,
data: &mut [f32],
) -> Result<(), NativeError>
pub fn read_output_index( &mut self, index: usize, data: &mut [f32], ) -> Result<(), NativeError>
Copy from a pre-resolved output slot; an invalid index is rejected by the bridge.