Skip to main content

DeviceService

cubecl_common::device

Trait DeviceService 

Source 
pub trait DeviceService: Send + 'static {
    // Required methods
    fn init(device_id: DeviceId) -> Self;
    fn utilities(&self) -> ServerUtilitiesHandle;

    // Provided method
    fn stage() -> DeviceServiceStage { ... }
}
Expand description

Represent a service that runs on a device.

Required Methods§

Source

fn init(device_id: DeviceId) -> Self

Initializes the service. It is only called once per device.

Source

fn utilities(&self) -> ServerUtilitiesHandle

Get the service utilities.

Provided Methods§

Source

fn stage() -> DeviceServiceStage

Which pipeline stage this service runs on.

Services on DeviceServiceStage::Upstream produce work ahead of time (e.g. autodiff graph construction, kernel fusion) that is consumed by DeviceServiceStage::Downstream services, which stream kernels to the device.

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors§