Skip to main content

logit_softcap_contract

Function logit_softcap_contract 

Source
pub fn logit_softcap_contract() -> Result<StandardOperationContract, VNextError>
Expand description

Applies cap * tanh(logit / cap) to one final-position vocabulary row. The output is deliberately in-place so samplers consume the semantically capped logits without retaining a second vocabulary-sized allocation.