Expand description
Weight initialization strategies
Functionsยง
- constant
- Initialize tensor with constant value
- kaiming_
normal - Initialize tensor with Kaiming/He normal (for ReLU)
- kaiming_
uniform - Initialize tensor with Kaiming/He uniform (for ReLU)
- normal
- Initialize tensor with normal distribution
- ones
- Initialize tensor with ones
- uniform
- Initialize tensor with uniform distribution
- xavier_
normal - Initialize tensor with Xavier/Glorot normal
- xavier_
uniform - Initialize tensor with Xavier/Glorot uniform
- zeros
- Initialize tensor with zeros