Enum ThroughputMode 

pub enum ThroughputMode {
    ComputeDirect {
        dtype: ElemType,
    },
    ComputeCmma {
        dtype: ElemType,
        config: ComputeCmmaConfig,
    },
    Memory(MemorySpec),
    Launch,
}

Represents the mode of a throughput computation.

Variants

ComputeDirect

Compute direct calculation without special hardware acceleration.

The ceiling is for operands of dtype, not arithmetic performed in it: where converting to f32 retires more, that is what the probe reports.

Fields

dtype: ElemType

The data type of the computation.

ComputeCmma

Compute cmma calculation with CMMA hardware acceleration.

Fields

dtype: ElemType

The data type of the computation.

config: ComputeCmmaConfig

The configuration of the CMMA operation.

Memory(MemorySpec)

Traffic across the memory interface, as described by its MemorySpec.

bytes is the total one pass moves, so a Copy splits it across two buffers where a Read takes it all from one.

Launch

Launch overhead measurement.

Implementations

impl ThroughputMode

pub const fn memory(access: MemoryAccess) -> ThroughputMode

access over as much as the interface will take at once.

pub const fn memory_probe(&self) -> Option<MemorySpec>

What this mode asks of a memory probe, or None for the modes that do not measure memory.

Trait Implementations

impl Clone for ThroughputMode

fn clone(&self) -> ThroughputMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ThroughputMode

impl Debug for ThroughputMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ThroughputMode

fn deserialize<__D>( __deserializer: __D, ) -> Result<ThroughputMode, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for ThroughputMode

impl Hash for ThroughputMode

fn hash<__H>(&self, state: &mut __H)

where __H: Hasher,

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for ThroughputMode

fn eq(&self, other: &ThroughputMode) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ThroughputMode

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ThroughputMode