Struct QuantizePerGroupArgs 

pub struct QuantizePerGroupArgs<'a, TIn: Element, TOut: IntElement> {
    pub input: TensorRef<'a, TIn, 2>,
    pub scale: TensorRef<'a, TIn, 2>,
    pub zero_point: TensorRef<'a, i32, 2>,
    pub output: TensorMut<'a, TOut, 2>,
}

Args bundle for a quantize_per_group forward launch.

Fields

input: TensorRef<'a, TIn, 2>

Input [outer_size, axis_size] in FP.

scale: TensorRef<'a, TIn, 2>

Per-group scale [outer_size, num_groups] in FP.

zero_point: TensorRef<'a, i32, 2>

Per-group zero-point [outer_size, num_groups] in i32.

output: TensorMut<'a, TOut, 2>

Output [outer_size, axis_size] in int.