3 ms·
The "Twenty Questions" explanation of Shannon entropy is definitely the most intuitive one I've read so far. I've heard it repeated it many times, but I do see
by alexpetralia 5y ago
The "Twenty Questions" explanation of Shannon entropy is definitely the most intuitive one I've read so far. I've heard it repeated it many times, but I do see yours is from 2006! Thanks for this.
In particular here is where I read it (pdf): http://tuvalu.santafe.edu/~simon/it.pdf http://tuvalu.santafe.edu/~simon/it.pdf