Skip to main content

Module subbyte

Module subbyte 

Source
Expand description

Sub-byte 4-bit (s4) quantization operations and layers.

Functionsยง

convolve_s4
Performs per-tensor quantized int4 (s4) 2D Convolution layer.
fully_connected_s4
Performs per-tensor quantized int4 (s4) Fully Connected layer.
pack_s4_pair
Packs two 4-bit signed integers (low, high) in the range [-8, 7] into a single byte.
unpack_s4_pair
Unpacks a byte containing two 4-bit signed integers into (low_nibble, high_nibble).