Module init

Module init 

Source
Expand description

Weight initialization strategies

Functionsยง

constant
Initialize tensor with constant value
kaiming_normal
Initialize tensor with Kaiming/He normal (for ReLU)
kaiming_uniform
Initialize tensor with Kaiming/He uniform (for ReLU)
normal
Initialize tensor with normal distribution
ones
Initialize tensor with ones
uniform
Initialize tensor with uniform distribution
xavier_normal
Initialize tensor with Xavier/Glorot normal
xavier_uniform
Initialize tensor with Xavier/Glorot uniform
zeros
Initialize tensor with zeros