pub struct LinearSwish { /* private fields */ }Expand description
LinearSwish activation
Combines linear transformation with SiLU (Swish) activation.
Can apply in either order based on reverse flag.
Implementations§
Source§impl LinearSwish
impl LinearSwish
Sourcepub fn new(
hidden_size: usize,
reverse: bool,
vb: VarBuilder<'_>,
) -> Result<Self>
pub fn new( hidden_size: usize, reverse: bool, vb: VarBuilder<'_>, ) -> Result<Self>
Create new LinearSwish layer
§Arguments
hidden_size- Input/output dimensionreverse- If true: SiLU(Linear(x)), if false: Linear(SiLU(x))vb- VarBuilder for parameter initialization
pub fn forward(&self, x: &Tensor) -> Result<Tensor>
Auto Trait Implementations§
impl Freeze for LinearSwish
impl !RefUnwindSafe for LinearSwish
impl Send for LinearSwish
impl Sync for LinearSwish
impl Unpin for LinearSwish
impl !UnwindSafe for LinearSwish
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more