Enum tch::nn::init::FanInOut

source ·
pub enum FanInOut {
    FanIn,
    FanOut,
}
Expand description

Number of features as input or output of a layer. In Kaiming initialization, choosing FanIn preserves the magnitude of the variance of the weights in the forward pass, choosing FanOut preserves this magnitude in the backward pass.

Variants§

§

FanIn

§

FanOut

Implementations§

Compute the fan-in or fan-out value for a weight tensor of the specified dims. https://github.com/pytorch/pytorch/blob/dbeacf11820e336e803bb719b7aaaf2125ae4d9c/torch/nn/init.py#L284

Trait Implementations§

Returns a copy of the value. Read more
Performs copy-assignment from source. Read more
Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Gets the TypeId of self. Read more
Immutably borrows from an owned value. Read more
Mutably borrows from an owned value. Read more

Returns the argument unchanged.

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Should always be Self
The resulting type after obtaining ownership.
Creates owned data from borrowed data, usually by cloning. Read more
Uses borrowed data to replace owned data, usually by cloning. Read more
The type returned in the event of a conversion error.
Performs the conversion.
The type returned in the event of a conversion error.
Performs the conversion.