Skip to main content

Module sparse

Module sparse 

Source
Expand description

Sparse threshold operator (Section 6.5, Paper 4).

SparseThresholdOperator shifts every score by -threshold and drops entries whose adjusted score is non-positive. This realizes the MAP-estimation interpretation of ReLU activation: documents below the threshold have zero posterior under the sparse prior.

Structsยง

SparseThresholdOperator