Struct HeteroExecutable 

pub struct HeteroExecutable { /* private fields */ }

A graph compiled across multiple devices. Feed inputs / params by name and run; intermediates that cross a device boundary round-trip through host memory.

Implementations

impl HeteroExecutable

pub fn compile(graph: &Graph, map: &DeviceMap, options: &CompileOptions) -> Self

Partition graph per map and compile each segment to its device.

pub fn with_fallback( graph: &Graph, primary: Device, fallback: Device, options: &CompileOptions, ) -> Self

compile with the DeviceMap::auto_fallback policy — run graph on primary, spilling unsupported ops to fallback.

pub fn set_param(&mut self, name: &str, data: &[f32])

Set a parameter value (routed to whichever segment(s) consume it).

pub fn run(&mut self, inputs: &[(&str, &[f32])]) -> Vec<Vec<f32>>

Run the pipeline: seed inputs + params, execute each segment on its device (transferring boundary tensors through host memory), return the graph outputs in declaration order.

pub fn num_segments(&self) -> usize

Number of device segments the graph was split into.

pub fn segment_devices(&self) -> Vec<Device>

The device of each segment, in execution order.