Struct TeChain 

pub struct TeChain<'a> {
    pub model: &'a Arc<CmfModel>,
    pub layers: &'a [TeChainLayer<'a>],
    pub n: usize,
    pub hidden: usize,
    pub heads: usize,
    pub kv_heads: usize,
    pub head_dim: usize,
    pub inter: usize,
    pub eps: f32,
    pub cs: &'a [f32],
}

A run of prompt-encoder layers over one causal sequence.

Fields

model: &'a Arc<CmfModel>

layers: &'a [TeChainLayer<'a>]

n: usize

hidden: usize

heads: usize

kv_heads: usize

head_dim: usize

inter: usize

eps: f32

cs: &'a [f32]

[n][head_dim / 2][2]: (cos, sin) of every row’s rotation angles.