Skip to main content

load_model_bytes_with_weights

onnx_runtime_loader

Function load_model_bytes_with_weights 

Source 
pub fn load_model_bytes_with_weights(
    bytes: &[u8],
    base_dir: impl AsRef<Path>,
) -> Result<(Graph, Arc<WeightStore>), LoaderError>
Expand description

Load a model from an in-memory protobuf buffer, returning both the Graph and the live WeightStore that backs all initializer data.

External initializer data (if any) is resolved relative to base_dir. The Arc<WeightStore> keeps every memory map alive for as long as any clone of the Arc exists.