Struct FusionCubeRuntime

pub struct FusionCubeRuntime<R: CubeRuntime, BT: BoolElement> { /* private fields */ }

Available on crate feature fusion only.

Fusion runtime for JIT runtimes.

Trait Implementations

impl<R: Debug + CubeRuntime, BT: Debug + BoolElement> Debug for FusionCubeRuntime<R, BT>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<R: CubeRuntime, BT: BoolElement> FusionRuntime for FusionCubeRuntime<R, BT>

type OptimizationState = CubeOptimizationState

The state that can be serialized for an optimization.

type Optimization = CubeOptimization<R>

Optimization type for the backend.

type FusionHandle = CubeFusionHandle<R>

Handle used to store tensor dynamically.

type FusionDevice = <R as CubeRuntime>::CubeDevice

Device used by the runtime.

type FusionClient = MutexFusionClient<FusionCubeRuntime<R, BT>>

The client to interact with the runtime.

type BoolRepr = BT

The type that represents booleans on the backend.

fn optimizations( device: R::Device, ) -> Vec<Box<dyn OptimizationBuilder<Self::Optimization>>>

The list of optimizations that will be used to optimize the computational graph.

impl<R, BT> Optimization<FusionCubeRuntime<R, BT>> for CubeOptimization<R>

where R: CubeRuntime, BT: BoolElement,

fn execute( &mut self, context: &mut Context<'_, <FusionCubeRuntime<R, BT> as FusionRuntime>::FusionHandle>, execution: &OrderedExecution<FusionCubeRuntime<R, BT>>, )

Execute the operation.

fn to_state(&self) -> CubeOptimizationState

Returns the state that can be serialized.

fn from_state(device: &R::Device, state: CubeOptimizationState) -> Self

Create the optimization from the state.