Skip to main content

Module drv

Module drv 

Source
Expand description

libnrt loader. We need three symbols — nrt_init, nrt_get_total_nc_count, and nrt_get_version — and a best-effort read of the Neuron-specific env vars that AWS containers set.

drop(sym) on a libloading::Symbol ends the borrow on its Library; Symbol doesn’t impl Drop but the lifetime parameter does the work.

Structs§

Loaded

Enums§

NeuronGen

Constants§

NRT_SUCCESS

Functions§

detect_generation
Best-effort generation detection. Prefers NEURON_INSTANCE_TYPE env hint (commonly set by AWS Deep Learning AMIs + containers), falls back to the Neuron runtime major version.
is_available
total_cores
version

Type Aliases§

NrtAddTensorToSetFn
NrtAllocTensorSetFn
NrtExecuteFn
NrtFreeTensorSetFn
NrtLoadFn
NrtModelHandle
NrtStatus
NrtTensorHandle
NrtTensorSetHandle
NrtUnloadFn