gam 0.3.99

Generalized penalized likelihood engine
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

//! Manifest entry for the SAE decoder column-space incoherence penalty.
//!
//! The implementation lives in [`DecoderIncoherencePenalty`]. It is a β-tier,
//! co-activation-masked cross-atom penalty,
//! `½·w·Σ_{j<k} W[j,k]·||B_j B_k^T||_F^2` for stored `(M_k, p_out)` decoder
//! blocks, used as the SAE separability lever for decoder atoms that co-fire
//! on the same observations.

use crate::terms::analytic_penalties::DecoderIncoherencePenalty;

use super::PenaltyManifest;

impl PenaltyManifest for DecoderIncoherencePenalty {
    const KIND_TAG: &'static str = "decoder_incoherence";
    const PYTHON_WRAPPER: &'static str = "DecoderIncoherencePenalty";
    /// Dense across atom decoder blocks; uses a Gauss-Newton HVP rather than a
    /// row-block diagonal curvature shortcut.
    const ROW_BLOCK_DIAGONAL: bool = false;
}