3 ms·
1. Entropy is a broken measurement 2. This is incorrect 3. There is no concept of entropy for a specific finite sequence Do you see what you did there? Entro
by nabla9 11y ago
1. Entropy is a broken measurement
2. This is incorrect
3. There is no concept of entropy for a specific finite sequence
Do you see what you did there? Entropy is limited concept if you want to advance compression beyond certain limit.
General note: There is tendency of commentators to nit-pick blog posts as if being in debate where the goal is to win. It would be more valuable if we would read the article and try to interpret the intended meaning behind them favorably. Of course there are parts that are over-simplified or incorrect. This is just writing in the blog, not fully thought out edited and peer reviewed writing.
- gajomi 11y agoWhile I agree with your general comments about the attitude we should have in evaluating/commenting on blog post I have to disagree with the specific critique of the above comment. The favorable interpretation of the article is that the OP understands the basic definition of entropy but didn't realize that it could be extended to other models that account for permutation symmetry. But if you have read about any authoritative accounts of information entropy (Shannon's 1948 expository article, which discusses permutation invariance, is an example) you would be aware that it is more generally applicable. Entropy is a famous concept, but it is also a famously misunderstood concept, and misunderstood frequently enough that I think we should err on the side of being charitable to the critics as long as their commentary is technically sound and focused. The OP could have probably done without last two sentences. Nevertheless, I would like to think that the article could have been greatly improved or possibly avoided entirely if the auothor had consulted AidanChurch818.