Module dfdx::losses

Standard loss functions such as mse, mae, cross entropy, and more.

Functions

cross_entropy_with_logits_loss

Cross entropy loss. This computes: -(logits.log_softmax() * target_probs).sum(-1).mean()

kl_div_with_logits_loss

KL Divergence loss. This computes (target_probs * (target_probs.log() - logits.log_softmax())).sum(-1).mean()

mae_loss

Mean absolute error. This computes (&targ - pred).abs().mean()

mse_loss

Mean Squared Error. This computes (&targ - pred).square().mean().

rmse_loss

Root Mean square error. This computes (&targ - pred).square().mean().sqrt()