Expand description
Compute server module.
Structs§
- Binding
- A binding represents a Handle that is bound to managed memory.
- Copy
Descriptor - A binding with shape and stride info for non-contiguous reading
- CubeDim
- The number of units across all 3 axis totalling to the number of working units in a cube.
- Handle
- Server handle containing the memory handle.
- Kernel
Arguments - Arguments to execute a kernel.
- Memory
Layout - An allocation with associated strides. Strides depend on tensor layout.
- Memory
Layout Descriptor - Descriptor for a new tensor allocation
- Metadata
Binding Info - Binding of a set of scalars of the same type to execute a kernel.
- Profiling
Token - Profiling identification so that the server can support recursive and overlapping profilings.
- Reason
- A reason for an error.
- Server
Utilities - Contains many different types that are useful for server implementations and compute clients.
- Stream
Error Mode - How errors are handled in a stream when executing a task.
- Tensor
MapBinding - A tensor map used with TMA ops
- Tensor
MapMeta TensorMapmetadata for the opaque proxy used in TMA copies
Enums§
- Cube
Count - Specifieds the number of cubes to be dispatched for a kernel.
- Cube
Count Selection - Defines how to select cube count based on the number of cubes required.
- Execution
Mode - The kind of execution to be performed.
- IoError
- Error returned from
create/read/writefunctions. Due to async execution not all errors are able to be caught, so some IO errors will still panic. - Launch
Error - Kernel Launch Errors.
- Memory
Layout Strategy - Type of allocation, either contiguous or optimized (row-aligned when possible)
- Profile
Error - An error during profiling.
- Reduce
Operation - Different reduce operations.
- Resource
Limit Error - Resource limit errors.
- Server
Error - Error that can happen asynchronously while executing registered kernels.
Traits§
- Compute
Server - The compute server is responsible for handling resources and computations over resources.
- Memory
Layout Policy - Defines how the memory layout is determined.
- Server
Communication - Defines functions for optimized data transfer between servers, supporting custom communication mechanisms such as peer-to-peer communication or specialized implementations.