In case might help anyone, found that the graphics on this TDS piece were very helpful for intuiting the principles of teacher / student distillation discussed

In case might help anyone, found that the graphics on this TDS piece were very helpful for intuiting the principles of teacher / student distillation discussed in the link. https://towardsdatascience.com/knowledge-distillation-simplified-dd4973dbc764 https://towardsdatascience.com/knowledge-distillation-simpli...