The Kullback Leibler Divergence has a closed form solution for two Gaussians. Here I will shortly derive this solution. If you need an intuitive refresher of the KL divergence you can have a look at a previous post of mine. Assume two Gaussian distributions – $q(x) \sim \mathcal{N}(\mu_q, \sigma_q)$ and…

Comments closed