Struct Session 

pub struct Session { /* private fields */ }

An inference session.

Sessions hold the runtime state for model inference, including allocated memory and intermediate tensors.

Thread Safety

Sessions can be used from multiple threads, but run() must not be called concurrently on the same session.

Implementations

impl Session

pub fn get_input(&self, name: Option<&str>) -> MnnResult<Tensor>

Get an input tensor by name.

Arguments

• name - The name of the input tensor (None for the first input)

Returns

A mutable reference to the input tensor.

pub fn get_output(&self, name: Option<&str>) -> MnnResult<Tensor>

Get an output tensor by name.

Arguments

• name - The name of the output tensor (None for the first output)

Returns

A reference to the output tensor.

pub fn run(&mut self) -> MnnResult<()>

Run inference.

This executes the model on the current input tensors and populates the output tensors.

Returns

Ok(()) on success, or an error on failure.

pub fn has_run(&self) -> bool

Check if the session has been run at least once.

pub fn memory_usage(&self) -> usize

Get the memory usage of this session in bytes.

pub fn flops(&self) -> f32

Get the FLOPS count of this session.

pub fn inner(&self) -> *mut MNNSession

Get the raw pointer to the underlying MNN session.

Safety

The returned pointer is owned by this Session and must not be freed.

pub fn inner_mut(&mut self) -> *mut MNNSession

Get the mutable raw pointer to the underlying MNN session.

Safety

The returned pointer is owned by this Session and must not be freed.

pub fn interpreter(&self) -> *mut MNNInterpreter

Get the interpreter pointer (not owned).

Safety

The returned pointer is owned by the Interpreter.

pub unsafe fn from_ptr( inner: *mut MNNSession, interpreter: *mut MNNInterpreter, ) -> Self

Create a new session from raw pointers.

Safety

The pointers must be valid and the interpreter must outlive the session.

Trait Implementations

impl Debug for Session

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for Session

fn drop(&mut self)

Executes the destructor for this type.

impl Send for Session

impl Sync for Session