...

/

Jensen-Shannon Divergence and Cross-Entropy Loss

Jensen-Shannon Divergence and Cross-Entropy Loss

Learn about Jensen-Shannon Divergence and Cross-Entropy Loss.

The PyTorch Image Model provides a special loss called JsdCrossEntropy. As the name suggests, it uses Jensen-Shannon divergence and cross-entropy to calculate the total loss.

Jensen-Shannon divergence

The Jensen-Shannon divergence is a well-known term in the probability theory and statistics domains. It’s symmetric, has finite values, and measures ...