List of all items

Structs

• attn::AttnConfig
• attn::AttnWeights
• attn::KvCache
• config::TransformerConfig
• ffn::FfnWeights
• layers::DecoderLayer
• layers::EncoderLayer
• model::NeedleModel
• quant::QuantizedWeight
• rope::RopeCache

Enums

• config::FfnActivation

Functions

• attn::cross_attn_incremental
• attn::self_attn_full
• attn::self_attn_incremental
• ffn::ffn_forward
• layers::decoder_layer_forward
• layers::encoder_layer_forward
• math::abs
• math::cos
• math::exp
• math::ln
• math::powf
• math::round
• math::sin
• math::sqrt
• math::tanh
• norm::zc_rms_norm
• norm::zc_rms_norm_vec
• ops::add_bias
• ops::dot
• ops::elementwise_mul
• ops::gelu
• ops::matmul
• ops::saxpy
• ops::sigmoid
• ops::softmax_inplace
• quant::has_avx2

Constants

• quant::GROUP_SIZE
• quant::SCALE_MIN