Struct QuantizedResidualAdd 

pub struct QuantizedResidualAdd { /* private fields */ }

Quantized Residual Addition

Adds two quantized tensors with potentially different scales: output = input1 + input2

Handles scale alignment and requantization.

Implementations

impl QuantizedResidualAdd

pub fn new(scale1: f32, scale2: f32) -> Self

Create a new quantized residual add layer

Arguments

• scale1 - Scale of first input
• scale2 - Scale of second input

pub fn forward_int8( &self, input1: &[u8], scale1: f32, zero_point1: u8, input2: &[u8], scale2: f32, zero_point2: u8, shape: &[usize], ) -> CnnResult<(Vec<u8>, f32, u8)>

Forward pass with INT8 inputs

Arguments

• input1 - First quantized u8 input
• scale1 - Scale of first input
• zero_point1 - Zero point of first input
• input2 - Second quantized u8 input
• scale2 - Scale of second input
• zero_point2 - Zero point of second input
• shape - Tensor shape (must be identical for both inputs)

Returns

(output, output_scale, output_zero_point)

pub fn forward_int8_i16( &self, input1: &[u8], scale1: f32, zero_point1: u8, input2: &[u8], scale2: f32, zero_point2: u8, shape: &[usize], ) -> CnnResult<(Vec<u8>, f32, u8)>

Forward pass with scale alignment (i16 intermediate precision)

More accurate version using i16 intermediate precision.

pub fn output_scale(&self) -> f32

Get output scale

pub fn output_zero_point(&self) -> u8

Get output zero point

Trait Implementations

impl Clone for QuantizedResidualAdd

fn clone(&self) -> QuantizedResidualAdd

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QuantizedResidualAdd

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.