Expand description
Weight initialization strategies for tensor operations.
Provides common initialization methods used in deep learning:
- Xavier/Glorot (uniform and normal)
- He/Kaiming (uniform and normal)
- LeCun (uniform and normal)
- Orthogonal initialization
- Sparse initialization
- Truncated normal
- Constant/zeros/ones
Uses a custom xorshift64 PRNG to avoid external random number dependencies.
Structs§
- Init
Stats - Statistics about initialised weights.
- Tensor
Shape - Shape information for computing fan-in/fan-out.
- Weight
Init Config - Configuration for weight initialization.
- Weight
Initializer - Weight initializer that generates tensors according to a chosen strategy.
Enums§
- FanMode
- Fan mode for calculating fan-in/fan-out
- Init
Distribution - Distribution type for initialization
- Init
Strategy - Weight initialization strategy