Good point on KL divergence not being symmetric. For anyone who wants to quantify KL divergence in a way that can be used as a metric, look into Jensen-Shannon

Good point on KL divergence not being symmetric. For anyone who wants to quantify KL divergence in a way that can be used as a metric, look into Jensen-Shannon distance which is based on KL-divergence.