Struct DequantizePerGroupArgs 

pub struct DequantizePerGroupArgs<'a, TIn: Element, TOut: IntElement> {
    pub input: TensorRef<'a, TOut, 2>,
    pub scale: TensorRef<'a, TIn, 2>,
    pub zero_point: TensorRef<'a, i32, 2>,
    pub output: TensorMut<'a, TIn, 2>,
}

Args for the dequant-per-group launch.

Fields

input: TensorRef<'a, TOut, 2>

Quantized input [outer, axis_size] in int.

scale: TensorRef<'a, TIn, 2>

Per-group scale [outer, num_groups] in FP.

zero_point: TensorRef<'a, i32, 2>

Per-group zero-point [outer, num_groups] in i32.

output: TensorMut<'a, TIn, 2>

Output [outer, axis_size] in FP.