Enum StageLayout 

pub enum StageLayout {
    Strided,
    PaddedRows,
    Blocks,
    PaddedBlocks,
    SwizzledBlocks,
}

How a stage’s rows lie over the shared memory banks.

Where a row spans a whole number of the banks’ 128 bytes, as a head dim or a step of K of 64 or 128 in f16 does, a matrix instruction, loading the same columns of several rows at once, reads one bank several times over. Padding each row by a chunk starts the next row on other banks, at a chunk a row; blocking the stage into the instruction’s tiles packs one tile’s rows into consecutive bytes instead, at none, and swizzling a tile’s chunks spreads its rows over the banks in place, also at none. Which reads faster is the device’s to say, so each is a setting.

Variants

Strided

Row-major over the whole stage, the rows in order.

PaddedRows

Row-major over the whole stage, each row one chunk longer.

Blocks

In tiles of the instruction, one after another, their rows in order.

PaddedBlocks

In tiles of the instruction, each of their rows one chunk longer.

SwizzledBlocks

In tiles of the instruction, each row’s chunks swizzled: what a fragment reads that hands every row its own address, as the tile DSL’s own transport does; a cmma fragment reads a tile off a pointer and a stride, and cannot.

Implementations

impl StageLayout

pub fn storage(self, stage: &Space, tile: Vec<(Axis, usize)>) -> StageStorage

The storage a stage over stage is held in, the instruction’s tile tile cells along each of its axes, which are the stage’s axes in the order the stage lays them.

Trait Implementations

impl Clone for StageLayout

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for StageLayout

impl Debug for StageLayout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for StageLayout

Nothing for the strided layout, so the settings that hold it keep their names.

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for StageLayout

impl Hash for StageLayout

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for StageLayout

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for StageLayout