Expand description
OLMo Model V2 - Clean implementation
OLMo (Open Language Model) from AI2 features:
- Standard transformer decoder architecture
- SwiGLU activation
- RoPE embeddings
- No biases in linear layers
OLMo Model V2 - Clean implementation
OLMo (Open Language Model) from AI2 features: