Struct QuantizePerTokenDescriptor 

pub struct QuantizePerTokenDescriptor {
    pub n: i32,
    pub d: i32,
    pub q_min: i32,
    pub q_max: i32,
    pub input_element: ElementKind,
    pub output_element: ElementKind,
}

Descriptor for a quantize_per_token forward op.

Fields

n: i32

Number of token rows (first axis of input/output).

d: i32

Feature dim (second axis of input/output).

q_min: i32

Quantization range lower bound (e.g. -128 for s8 symmetric).

q_max: i32

Quantization range upper bound (e.g. 127 for s8 symmetric).

input_element: ElementKind

Input FP element kind. Must match TIn::KIND.

output_element: ElementKind

Output int element kind (s8 or u8). Must match TOut::KIND.

Trait Implementations

impl Clone for QuantizePerTokenDescriptor

fn clone(&self) -> QuantizePerTokenDescriptor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for QuantizePerTokenDescriptor

impl Debug for QuantizePerTokenDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.