Struct DynamicRangeQuantizeDescriptor 

pub struct DynamicRangeQuantizeDescriptor {
    pub n: i32,
    pub d: i32,
    pub q_min: i32,
    pub q_max: i32,
    pub mode: DynamicRangeMode,
    pub scope: DynamicRangeScope,
    pub input_element: ElementKind,
    pub output_element: ElementKind,
}

Descriptor for a dynamic_range_quantize op.

Fields

n: i32

Number of token rows (first axis of input / output).

d: i32

Feature dim (second axis).

q_min: i32

Quantization range lower bound (e.g. -127 for symmetric s8).

q_max: i32

Quantization range upper bound (e.g. 127 for symmetric s8).

mode: DynamicRangeMode

Symmetric / asymmetric mode.

scope: DynamicRangeScope

Per-tensor / per-channel / per-token / per-group scope.

input_element: ElementKind

Input FP element kind. Must match TIn::KIND.

output_element: ElementKind

Output int element kind (must match TOut::KIND). S8 only.

Trait Implementations

impl Clone for DynamicRangeQuantizeDescriptor

fn clone(&self) -> DynamicRangeQuantizeDescriptor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for DynamicRangeQuantizeDescriptor

impl Debug for DynamicRangeQuantizeDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.