pub enum FanInOut {
FanIn,
FanOut,
}
Expand description
Number of features as input or output of a layer.
In Kaiming initialization, choosing FanIn
preserves
the magnitude of the variance of the weights in the
forward pass, choosing FanOut
preserves this
magnitude in the backward pass.
Compute the fan-in or fan-out value for a weight tensor of
the specified dims.
https://github.com/pytorch/pytorch/blob/dbeacf11820e336e803bb719b7aaaf2125ae4d9c/torch/nn/init.py#L284
Performs copy-assignment from
source
.
Read more
Formats the value using the given formatter.
Read more
Immutably borrows from an owned value.
Read more
Mutably borrows from an owned value.
Read more
Returns the argument unchanged.
Calls U::from(self)
.
That is, this conversion is whatever the implementation of
From<T> for U
chooses to do.
The resulting type after obtaining ownership.
Creates owned data from borrowed data, usually by cloning.
Read more
Uses borrowed data to replace owned data, usually by cloning.
Read more
The type returned in the event of a conversion error.
Performs the conversion.
The type returned in the event of a conversion error.
Performs the conversion.