Expand description
Examples from Chapter 3
Modules§
- addons
- Auxiliary module for examples::ch03
Structs§
- EG01
- Computing attention scores as a dot product
- EG02
- Manual computation of multiple context vectors simultaneously
- EG03
- Implementing the self-attention mechanism with trainable weights
- EG04
- Example usage of
SelfAttentionV1to compute context vectors - EG05
- Example usage of
SelfAttentionV2to compute context vectors - EG06
- Compute causal attention weights
- EG07
- Compute causal attention weights more efficiently with
f32::NEGATIVE_INFINITY - EG08
- Dropout on attention weights
- EG09
- Example usage of
CausalAttention - EG10
- Example usage of
MultiHeadAttentionWrapper - EG11
- Example usage of
MultiHeadAttention