[−][src]Enum onednn_sys::dnnl_normalization_flags_t
Flags for normalization primitives.
Variants (Non-exhaustive)
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
Use no normalization flags
If specified
- on forward training propagation mean and variance are computed and stored as output
- on backward propagation compute full derivative wrt data
- on backward propagation prop_kind == #dnnl_backward_data has the same behavior as prop_kind == #dnnl_backward
Use global statistics
If specified
- on forward propagation use mean and variance provided by user (input)
- on backward propagation reduces the amount of computations, since mean and variance are considered as constants
If not specified:
- on forward propagation mean and variance are computed and stored as output
- on backward propagation compute full derivative wrt data
Use scale and shift parameters
If specified:
- on forward propagation use scale and shift (aka scale and bias) for the batch normalization results
- on backward propagation (for prop_kind == #dnnl_backward) compute diff wrt scale and shift (hence one extra output used)
If no specified:
- on backward propagation prop_kind == #dnnl_backward_data has the same behavior as prop_kind == #dnnl_backward
Fuse with ReLU
The flag implies negative slope being 0. On training this is the only configuration supported. For inference, to use non-zero negative slope consider using @ref dev_guide_attributes_post_ops.
If specified:
- on inference this option behaves the same as if the primitive were fused with ReLU using post ops API with zero negative slope.
- on training primitive requires workspace (required to be able to perform backward pass)
Trait Implementations
impl Clone for dnnl_normalization_flags_t
[src]
fn clone(&self) -> dnnl_normalization_flags_t
[src]
fn clone_from(&mut self, source: &Self)
1.0.0[src]
impl Copy for dnnl_normalization_flags_t
[src]
impl Debug for dnnl_normalization_flags_t
[src]
impl Eq for dnnl_normalization_flags_t
[src]
impl Hash for dnnl_normalization_flags_t
[src]
fn hash<__H: Hasher>(&self, state: &mut __H)
[src]
fn hash_slice<H>(data: &[Self], state: &mut H) where
H: Hasher,
1.3.0[src]
H: Hasher,
impl PartialEq<dnnl_normalization_flags_t> for dnnl_normalization_flags_t
[src]
fn eq(&self, other: &dnnl_normalization_flags_t) -> bool
[src]
#[must_use]fn ne(&self, other: &Rhs) -> bool
1.0.0[src]
impl StructuralEq for dnnl_normalization_flags_t
[src]
impl StructuralPartialEq for dnnl_normalization_flags_t
[src]
Auto Trait Implementations
impl RefUnwindSafe for dnnl_normalization_flags_t
impl Send for dnnl_normalization_flags_t
impl Sync for dnnl_normalization_flags_t
impl Unpin for dnnl_normalization_flags_t
impl UnwindSafe for dnnl_normalization_flags_t
Blanket Implementations
impl<T> Any for T where
T: 'static + ?Sized,
[src]
T: 'static + ?Sized,
impl<T> Borrow<T> for T where
T: ?Sized,
[src]
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
[src]
T: ?Sized,
fn borrow_mut(&mut self) -> &mut T
[src]
impl<T> From<T> for T
[src]
impl<T, U> Into<U> for T where
U: From<T>,
[src]
U: From<T>,
impl<T> ToOwned for T where
T: Clone,
[src]
T: Clone,
type Owned = T
The resulting type after obtaining ownership.
fn to_owned(&self) -> T
[src]
fn clone_into(&self, target: &mut T)
[src]
impl<T, U> TryFrom<U> for T where
U: Into<T>,
[src]
U: Into<T>,
type Error = Infallible
The type returned in the event of a conversion error.
fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>
[src]
impl<T, U> TryInto<U> for T where
U: TryFrom<T>,
[src]
U: TryFrom<T>,