Expand description
Thin wrappers over nrt_load / nrt_execute. The AWS Neuron
Runtime takes a NEFF binary (produced by the Neuron compiler) plus
two tensor sets (inputs + outputs) and runs it on one or more
NeuronCores. We don’t ship the compiler — we expect the caller to
have a .neff already.
Structs§
- Model
- Compiled Neuron model, loaded from a NEFF binary onto one or more NeuronCores.
- Tensor
Set - A named collection of tensors — the input or output side of an execute call.