Expand description
LFM2 (Liquid foundation model) blocks.
Structs§
- Lfm2
Block - LFM2 block:
x + op(norm(x))thenh + mlp(norm(h)). - Lfm2
Conv - LFM2 short-convolution operator: projection, depthwise conv, projection.
- Lfm2
Model - A decoder-only language model: LFM2 (mixed conv/attention blocks) or
Llama-style (every block is attention), as built by
Lfm2ModelBuilder.
Enums§
- Lfm2
Layer Op - The token-mixing operator of an LFM2 block.