Skip to main content

Module byte

Module byte 

Source
Expand description

Quantized-domain NMS, the int8 / uint8 mirror of crate::float.

These kernels suppress and post-process candidates while the scores are still in their raw integer units, which is the point: dequantizing every anchor costs more than dequantizing the handful that survive. The threshold crosses the other way instead — [quantize_score_threshold] maps a float score threshold into the tensor’s quantized domain so the comparison stays an integer one.

[postprocess_boxes_quant] and [postprocess_boxes_index_quant] handle candidate selection; [nms_int], [nms_class_aware_int], and their _extra payload-carrying variants handle suppression. Boxes are dequantized only after suppression.

Functions§

postprocess_boxes_multilabel_index_quant
Multi-label variant of [postprocess_boxes_index_quant]: one entry per class at or above threshold, sharing the anchor’s bbox and index.
postprocess_boxes_multilabel_quant
postprocess_boxes_multilabel_index_quant without anchor indices.