Module throughput 

Throughput related utilities.

Structs

CmmaDims

The M, N, and K dimensions of a matrix multiplication.

ComputeCmmaConfig

Configuration for a matrix multiplication (CMMA) operation.

KernelConfig

Configuration and payload for a benchmarkable compute kernel.

ThroughputBenchmarker

A marker for measuring throughput of compute kernels.

ThroughputCache

Caches the ThroughputValue for a given ThroughputKey.

ThroughputKey

Represents a key/configuration used to identify the throughput of a computation.

ThroughputValue

Represents the throughput of a computation, including the number of operations and the duration.

Enums

ThroughputMode

Represents the mode of a throughput computation.

Functions

compute_throughput_key

Constructs a compute ThroughputKey based on CMMA tile availability and types.

select_cmma_tile

Resolves the largest supported CMMA or MMA tile size (m, n, k).

Type Aliases

AccumulatorType

The element type of the accumulator.