Module utils

Module utils 

Source

Functionsยง

count_parameters
Calculate the number of parameters in a tensor
create_causal_mask
Create a causal mask for attention
trunc_normal_init
Truncated normal initialization