Module bloom 

BLOOM Model V2 - Clean implementation

BLOOM architecture features:

• ALiBi (Attention with Linear Biases) position embeddings
• No bias in attention projections
• LayerNorm before attention

Structs

BLOOMAttention

BLOOMConfig

BLOOMLayer

BLOOMMLP

BLOOMModelV2