Crate cubecl_runtime

Expand description

CubeCL runtime crate that helps creating high performance async runtimes.

Modules§

benchmark: Module for benchmark timings
channel: Compute channel module.
client: Compute client module.
config: CubeCL config module.
id: Various identifier types used in CubeCL.
kernel: Kernel related traits.
logging: Logging utilities to be used by a compute server.
memory_management: Memory management module.
server: Compute server module.
storage: Compute Storage module.
timestamp_profiler: Simple system profiling using timestamps.
tma: TMA-related runtime types
tune: Autotune module

Macros§

local_tuner: Create a local tuner with the provided name.
memory_id_type: Create new memory ID types.
storage_id_type: Create a new storage ID type.

Structs§

ComputeRuntime: The compute type has the responsibility to retrieve the correct compute client based on the given device.
DeviceProperties: Properties of what the device can do, like what Feature are supported by it and what its memory properties are.