Enum Field 

pub enum Field {
    Quant(QuantValue),
    Fp8(Fp8Format),
    Float(FloatKind),
    Index {
        bits: usize,
    },
    ConvertedE2M1,
    Placed {
        value: QuantValue,
        lifted: bool,
    },
}

The slot one packed value occupies.

Variants

Quant(QuantValue)

Fp8(Fp8Format)

Float(FloatKind)

Index

An index bits wide into a table, its codebook (TileArgLaunch::codebook), read as raw bits.

Fields

bits: usize

ConvertedE2M1

An e2m1 code on a device that converts e2m1x2 itself: a word is read as four of them and cast, the decode left to the compiler. What read_on makes of Quant(E2M1) there.

Placed

A float code (e2m1, e4m3 or e5m2) on a device that emulates converting it: a word is decoded as f16 pairs from its bits, lifted to its values, or, where lifted is false, each placed lift short of its value for a reader whose factor carries the lift (a tile read placed). What read_on makes of Quant(value) there, lifted.

Fields

value: QuantValue

lifted: bool

Implementations

impl Field

pub fn size_bits(self) -> usize

The slot’s width in bits.

pub fn per_word(self) -> usize

Values one u32 holds.

pub fn holds_e2m1(self) -> bool

Whether the slot holds an e2m1 code, however the device reads it (read_on): what a reader that takes the codes’ values whole asks.

impl Field

pub fn read_on(self, client: &Client) -> Field

This field as the device client reads it: a float code (e2m1, e4m3, e5m2) decoded from its bits where the device emulates converting it anyway, so a reader’s factor can carry the decode’s lift; an e2m1 code converted by the device where it converts e2m1x2 itself; every other field as it is. A device’s own conversion is the one its compiler lowers best, so where it exists a software decode is only ever slower.

pub fn of_float(kind: FloatKind) -> Field

The field a float of kind occupies.

pub fn of_scale(dtype: ScaleDtype) -> Field

The field a scale of dtype occupies in its stored word.

Trait Implementations

impl Clone for Field

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Field

impl Debug for Field

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for Field

impl From<FloatKind> for Field

An 8-bit float is a Fp8 field, a wider one a Float field.

fn from(kind: FloatKind) -> Self

Converts to this type from the input type.

impl From<Fp8Format> for Field

fn from(format: Fp8Format) -> Self

Converts to this type from the input type.

impl From<QuantValue> for Field

fn from(value: QuantValue) -> Self

Converts to this type from the input type.

impl Hash for Field

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Field

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Field