Struct Prediction 

pub struct Prediction { /* private fields */ }

Implementations

impl Prediction

pub fn get_f32(&self, name: &str) -> Result<(Vec<f32>, Vec<usize>)>

Get an output as (Vec, shape), converting from the model’s native data type. Allocates a new Vec for the output data.

Examples found in repository

examples/load_and_predict.rs (line 23)

fn main() {
    let model_path = std::env::args()
        .nth(1)
        .unwrap_or_else(|| "tests/fixtures/test_linear.mlmodelc".to_string());

    println!("Loading model: {model_path}");
    let model = Model::load(&model_path, ComputeUnits::All).expect("Failed to load model");

    // Create a simple input tensor
    let input_data = vec![1.0f32, 2.0, 3.0, 4.0];
    let tensor =
        BorrowedTensor::from_f32(&input_data, &[1, 4]).expect("Failed to create tensor");

    println!("Running prediction...");
    let prediction = model.predict(&[("input", &tensor)]).expect("Prediction failed");

    let (output, shape) = prediction.get_f32("output").expect("Failed to get output");
    println!("Output shape: {shape:?}");
    println!("Output data: {output:?}");
}

pub fn get_f32_into(&self, name: &str, buf: &mut [f32]) -> Result<Vec<usize>>

Copy an output into a caller-provided f32 buffer (zero-alloc hot path).

Returns the shape. The buffer must be large enough to hold all elements.

pub fn get_i32(&self, name: &str) -> Result<(Vec<i32>, Vec<usize>)>

Get an output as (Vec, shape). Only works if the output is Int32.

pub fn get_f64(&self, name: &str) -> Result<(Vec<f64>, Vec<usize>)>

Get an output as (Vec, shape). Only works if the output is Float64.

pub fn get_raw( &self, name: &str, ) -> Result<(Vec<u8>, Vec<usize>, Option<DataType>)>

Get an output as raw bytes and its shape + data type.

Trait Implementations

impl Send for Prediction

Available on Apple only.

impl Sync for Prediction

Available on Apple only.