Module fused

Module fused 

Source
Expand description

Fused operations for maximum memory efficiency

Structs§

AdamConfig
Adam optimizer configuration

Functions§

fused_adam_update
Fused Adam update operation: combines momentum, variance, and parameter update in one pass
fused_apply_constraints
Fused parameter constraint application
fused_gradient_clip_normalize
Fused gradient clipping and normalization
fused_sgd_update
Fused SGD with momentum and weight decay