Struct SmoothQuantLinearDescriptor 

#[non_exhaustive]
pub struct SmoothQuantLinearDescriptor {
    pub m: i32,
    pub n: i32,
    pub k: i32,
    pub act_scale: f32,
    pub activation_element: ElementKind,
    pub weight_element: ElementKind,
    pub output_element: ElementKind,
}

Descriptor for a SmoothQuant linear op.

The per-tensor activation scale lives in the descriptor (not the args) because in the SmoothQuant flow it’s part of the model’s frozen quantization metadata — it doesn’t change between launches for the same layer.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

m: i32

Number of token rows in the activation (and rows of the output).

n: i32

Number of output channels (rows of weight_q, cols of output).

k: i32

Inner reduction dim (cols of act_q and weight_q).

act_scale: f32

Per-tensor activation scale produced by the offline SmoothQuant Python flow. Always f32 regardless of TIn — the underlying quantized_linear_w8a8 kernel does the scale multiply in float space irrespective of output dtype.

activation_element: ElementKind

Activation int element kind. Today wired only for S8.

weight_element: ElementKind

Weight int element kind. Today wired only for S8.

output_element: ElementKind

Output FP element kind. Must match TIn::KIND.

Implementations

impl SmoothQuantLinearDescriptor

pub fn new<TIn: Element>(m: i32, n: i32, k: i32, act_scale: f32) -> Self

Construct a SmoothQuantLinearDescriptor for the given problem shape and per-tensor activation scale. Defaults S8 for both activation and weight; output element matches TIn::KIND.

Trait Implementations

impl Clone for SmoothQuantLinearDescriptor

fn clone(&self) -> SmoothQuantLinearDescriptor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SmoothQuantLinearDescriptor

impl Debug for SmoothQuantLinearDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.