3 ms·
Ask HN: Self-Studying Information Theory
Hello!
I want to explore basics of information theory. Despite having math background, I've realized that I lack a comprehensive understanding of key concepts (e.g. entropy) in this area. I am particularly interested in formal connection between compression and intelligence.
I'm currently seeking resources that would work for self-learning, ideally Jupyter notebooks that would allow me to interactively experiment with the simulations/examples. In the absence of such resources, a book with exercises section could also work.
Thanks!