Struct Model 

pub struct Model { /* private fields */ }

Compiled Neuron model, loaded from a NEFF binary onto one or more NeuronCores.

Implementations

impl Model

pub fn load( neff: &[u8], start_nc: i32, nc_count: i32, ) -> Result<Self, NeuronError>

Load neff onto NeuronCores [start_nc, start_nc + nc_count). nc_count = 1 is the typical case for a single-core inference model; multi-core is used for tensor-parallel Trn1/Trn2 graphs.

pub fn execute( &self, inputs: &TensorSet, outputs: &TensorSet, ) -> Result<(), NeuronError>

Execute this model with pre-populated input / output tensor sets. Blocks until the NeuronCore signals completion.

pub fn raw(&self) -> NrtModelHandle

Trait Implementations

impl Drop for Model

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.