Struct HipServer

pub struct HipServer { /* private fields */ }

Trait Implementations

impl ComputeServer for HipServer

type Kernel = Box<dyn CubeTask<CppCompiler<HipDialect<RocWmmaCompiler>>>>

The kernel type defines the computation algorithms.

type Storage = HipStorage

The storage type defines how data is stored and accessed.

type Feature = Feature

The type of the features supported by the server.

type Info = ()

Information that can be retrieved for the runtime.

fn read( &mut self, bindings: Vec<Binding>, ) -> impl Future<Output = Vec<Vec<u8>>> + 'static

Given bindings, returns the owned resources as bytes.

fn read_tensor( &mut self, bindings: Vec<BindingWithMeta>, ) -> impl Future<Output = Vec<Vec<u8>>> + 'static

Given tensor handles, returns the owned resources as bytes.

fn memory_usage(&self) -> MemoryUsage

The current memory usage of the server.

fn memory_cleanup(&mut self)

Ask the server to release memory that it can release.

fn create(&mut self, data: &[u8]) -> Handle

Given a resource as bytes, stores it and returns the memory handle.

fn create_tensor( &mut self, data: &[u8], shape: &[usize], _elem_size: usize, ) -> (Handle, Vec<usize>)

Given a resource as bytes with shape, stores it and returns the tensor handle. May or may not be contiguous, depending on what’s best for the given runtime. Always use strides to index. For example, in CUDA, this will allocate a padded tensor where the last dimension is padded to the cache lines, so row access is faster.

fn empty(&mut self, size: usize) -> Handle

Reserves size bytes in the storage, and returns a handle over them.

fn empty_tensor( &mut self, shape: &[usize], elem_size: usize, ) -> (Handle, Vec<usize>)

Reserves shape bytes in the storage, and returns a handle to it.

unsafe fn execute( &mut self, kernel: Self::Kernel, count: CubeCount, bindings: Bindings, mode: ExecutionMode, )

Executes the kernel over the given memory handles.

fn flush(&mut self)

Flush all outstanding tasks in the server.

fn sync(&mut self) -> impl Future<Output = ()> + 'static

Wait for the completion of every task in the server.

fn start_profile(&mut self)

Enable collecting timestamps.

fn end_profile(&mut self) -> ProfileDuration

Disable collecting timestamps.

fn get_resource(&mut self, binding: Binding) -> BindingResource<HipResource>

Given a resource handle, returns the storage resource.

impl Debug for HipServer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Send for HipServer