I really like Kenneth Rose's review [1] of deterministic annealing, which is the most simple and concrete example of the Information Bottleneck method that I kn

I really like Kenneth Rose's review [1] of deterministic annealing, which is the most simple and concrete example of the Information Bottleneck method that I know of. I wanted to work with a concrete example and get some intuition, so I wrote some Julia code [2] a couple of years ago. Should be fairly easy to tweak it to run with Julia v1.0, or translate to Python, in case anyone's interested. [1]: https://scl.ece.ucsb.edu/sites/scl.ece.ucsb.edu/files/publications/b98_2_0.pdf https://scl.ece.ucsb.edu/sites/scl.ece.ucsb.edu/files/public... [2]: https://github.com/sivark/DeterministicAnnealing/blob/master/DeterministicAnnealing.ipynb https://github.com/sivark/DeterministicAnnealing/blob/master...