...
/Jensen-Shannon Divergence and Cross-Entropy Loss
Jensen-Shannon Divergence and Cross-Entropy Loss
Learn about Jensen-Shannon Divergence and Cross-Entropy Loss.
We'll cover the following...
The PyTorch Image Model provides a special loss called JsdCrossEntropy
. As the name suggests, it uses Jensen-Shannon divergence and cross-entropy to calculate the total loss.
Jensen-Shannon divergence
The Jensen-Shannon divergence is a well-known term in the probability theory and statistics domains. It’s symmetric, has finite values, and measures ...