Skip to main content

Module lfm

Module lfm 

Source
Expand description

LFM2 (Liquid foundation model) blocks.

Structs§

Lfm2Block
LFM2 block: x + op(norm(x)) then h + mlp(norm(h)).
Lfm2Conv
LFM2 short-convolution operator: projection, depthwise conv, projection.
Lfm2Model
A decoder-only language model: LFM2 (mixed conv/attention blocks) or Llama-style (every block is attention), as built by Lfm2ModelBuilder.

Enums§

Lfm2LayerOp
The token-mixing operator of an LFM2 block.