Expand description
Components for matrix multiplication
Modules§
- as_
cmma_ layout - batch
- Executes multiple independent global matmuls with optional broadcasting.
- global
- Solves full reductions by loading blocks into shared memory. Handles memory movement, bound checks, plane specialization.
- stage
- tile
- Matrix multiplication on register- or shared-memory tiles. Optimized for fixed shapes and low-level compute strategies.
Structs§
- Available
Line Sizes - Candidate line sizes supported for each tensor.
- Formatted
Config Error - Error that arises from invalid configurations
- Global
Partition Size - Number of global matmul blocks computed by a single cube.
- Matmul
Line Sizes - Line size used for each tensor in global memory accesses. Represents the number of elements processed per SIMD load/store.
- Matmul
Problem - Description of a matmul problem to solve, regardless of actual data
- Matmul
Problem Size - Matmul
Problem Size Expand - Matmul
Selection - Matmul
Selection Builder - Partition
Size - Partition
Size Expand - Quantized
- ReplaceES
- Stage
Size - Stage
Size Expand - Tile
Size - Tile
Size Expand - Tiling
Scheme - Complete tiling configuration for a matmul. Encodes all structural information needed to compute tiling shapes and counts.
- Tiling
Scheme Builder - Builder for
TilingScheme. Allows step-by-step configuration.
Enums§
- Compute
Resources - Number of compute primitives required by some component, specified as either units or planes.
- Ident
- Identifier for all three tensors in a matmul
- Input
Ident - Identifier for the two input tensors in a matmul.
- Loading
Precompute Strategy - Matmul
Availability Error - A specific feature required for matmul is not available in the current runtime or hardware.
- Matmul
Dim - Matrix dimension specifier for matmul operations.
- Matmul
Kind - Interpretation of matrix multiplication based on input shapes.
- Matmul
Setup Error - Errors that can occur during the setup phase of a matmul operation.
- Matrix
Layout - Layout of a 2D structure such as a tensor, shared memory or slice, used within any matmul kernel level
- Matrix
Layout Expand - Multi
RowStrategy
Traits§
- Matmul
Precision - Matrix multiplication precisions.
- Matmul
Spec - Matrix multiplication spec definiting each element types used in the computation as well as how the arguments are passed to the kernel.
Functions§
- as_
cmma_ layout - Maps the matmul MatrixLayout to cmma’s MatrixLayout, for use in Cmma API.
Type Aliases§
- Args
- EA
- EI
- EO
- ES
- Input
Arg - Input argument
- Input
Runtime Arg - Input runtime argument
- Invalid
Config Error - Error that arises from invalid configurations
- Output
Arg - Output argument
- Output
Runtime Arg - Output runtime argument