pub struct LeakyReluGradTag {
pub slope_bits: u64,
}Expand description
LeakyRelu gradient tag — NOT a ZST; carries slope encoded as f64::to_bits().
Same static-string constraint prevents UnaryOpTag implementation.
Handled explicitly in fuse evaluator.
Fields§
§slope_bits: u64f64::to_bits(slope) — negative-region slope.
Implementations§
Source§impl LeakyReluGradTag
impl LeakyReluGradTag
Sourcepub fn apply<T: Scalar + FloatElement>(&self, x: T) -> T
pub fn apply<T: Scalar + FloatElement>(&self, x: T) -> T
Apply LeakyReLU gradient: x > 0 ? 1 : slope.
Matches PyTorch’s contract for both F.leaky_relu and F.prelu:
the gradient is slope at every x <= 0 (inclusive of the kink
at zero) and 1 everywhere else. This makes the leaky gradient
continuous from the left at the kink so downstream reduction
stability is preserved irrespective of whether a sample lands on
x = 0 exactly or merely rounds into it.
Trait Implementations§
Source§impl Clone for LeakyReluGradTag
impl Clone for LeakyReluGradTag
impl Copy for LeakyReluGradTag
Auto Trait Implementations§
impl Forget for LeakyReluGradTag
impl Freeze for LeakyReluGradTag
impl Move for LeakyReluGradTag
impl RefUnwindSafe for LeakyReluGradTag
impl Send for LeakyReluGradTag
impl Sync for LeakyReluGradTag
impl Unpin for LeakyReluGradTag
impl UnsafeUnpin for LeakyReluGradTag
impl UnwindSafe for LeakyReluGradTag
Blanket Implementations§
Source§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
Source§type ArchivedMetadata = ()
type ArchivedMetadata = ()
The archived version of the pointer metadata for this type.
Source§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Converts some archived metadata to the pointer metadata for itself.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> LayoutRaw for T
impl<T> LayoutRaw for T
Source§fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
Returns the layout of the type.
Source§impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
Source§unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
Returns whether the given value has been niched. Read more
Source§fn resolve_niched(out: Place<NichedOption<T, N1>>)
fn resolve_niched(out: Place<NichedOption<T, N1>>)
Writes data to
out indicating that a T is niched.