Enum DynamicRangeScope 

#[non_exhaustive]
pub enum DynamicRangeScope {
    Tensor,
    Channel {
        axis: i32,
    },
    Token,
    Group {
        axis: i32,
        group_size: i32,
    },
}

Per-tensor / per-channel / per-token / per-group granularity for the scale + zero_point computation.

Only DynamicRangeScope::Token is wired in the 8.3 trailblazer.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Tensor

One (scale, zp) for the whole tensor. Reserved.

Channel

One (scale, zp) per slice along axis. Reserved.

Fields

axis: i32

Axis along which to slice.

Token

One (scale, zp) per token row (first axis of a [N, D] tensor). Trailblazer scope.

Group

One (scale, zp) per group along axis. Reserved.

Fields

axis: i32

Axis along which to group.

group_size: i32

Number of elements per group.

Trait Implementations

impl Clone for DynamicRangeScope

fn clone(&self) -> DynamicRangeScope

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for DynamicRangeScope

impl Debug for DynamicRangeScope

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for DynamicRangeScope

impl PartialEq for DynamicRangeScope

fn eq(&self, other: &DynamicRangeScope) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for DynamicRangeScope