Enum KnownScale 

pub enum KnownScale {
    None,
    Global(f32),
    Whole(f32),
}

The part of each read’s scale the caller already knew when it built the view, held in one register rather than read per position; whatever is not known up front is read through the scales view. The discriminant is comptime, so each variant compiles its own kernel with nothing of the others in it.

Variants

None

Nothing known up front: each read looks its whole scale up at its position.

Global(f32)

The per-tensor scale of a two-level scheme; each read still looks its block scale up and multiplies this in.

Whole(f32)

The whole scale, whatever the caller multiplied into it. The scales view is never read: its address arithmetic and its load leave the kernel.

Implementations

impl KnownScale

pub fn new_None() -> Self

pub fn __expand_new_None(_: &Scope) -> KnownScaleExpand

pub fn new_Global(_0: f32) -> Self

pub fn __expand_new_Global( _: &Scope, _0: <f32 as CubeType>::ExpandType, ) -> KnownScaleExpand

pub fn new_Whole(_0: f32) -> Self

pub fn __expand_new_Whole( _: &Scope, _0: <f32 as CubeType>::ExpandType, ) -> KnownScaleExpand

impl KnownScale

pub fn effective(&self, scale: f32) -> f32

The scale a value dequantizes against once scale, looked up for its position, meets what this register holds.

pub fn __expand_effective( scope: &Scope, this: &<Self as CubeType>::ExpandType, scale: <f32 as CubeType>::ExpandType, ) -> <f32 as CubeType>::ExpandType

The scale a value dequantizes against once scale, looked up for its position, meets what this register holds.

Trait Implementations

impl Clone for KnownScale

fn clone(&self) -> KnownScale

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for KnownScale

impl CubeDebug for KnownScale

fn set_debug_name(&self, scope: &Scope, name: &'static str)

Set the debug name of this type’s expansion. Should do nothing for types that don’t appear at runtime

impl CubeType for KnownScale

type ExpandType = KnownScaleExpand

impl LaunchArg for KnownScale

type RuntimeArg<R: Runtime> = KnownScaleArgs<R>

The runtime argument for the kernel.

type CompilationArg = KnownScaleCompilationArg

Compilation argument.

fn register<R: Runtime>( runtime_arg: Self::RuntimeArg<R>, launcher: &mut KernelLauncher<R>, ) -> Self::CompilationArg

fn expand( arg: &Self::CompilationArg, builder: &mut KernelBuilder, ) -> <Self as CubeType>::ExpandType

Register a variable during compilation that fill the KernelBuilder.