Skip to main content

Module view

Module view 

Source

Structs§

QuantizedView
View that dequantizes after loads. Scales layout should take values coordinates and map them to the corresponding scale.
QuantizedViewCompilationArg
QuantizedViewExpand
QuantizedViewLaunch

Enums§

KnownScale
The part of each read’s scale the caller already knew when it built the view, held in one register rather than read per position; whatever is not known up front is read through the scales view. The discriminant is comptime, so each variant compiles its own kernel with nothing of the others in it.
KnownScaleArgs
KnownScaleCompilationArg
KnownScaleExpand

Functions§

run_with_quant_type
Run a function with the quantization storage type and scale. Useful when concrete types are required but aren’t available, and only the dynamic schema is known.