3 ms·
I would say it has better entropy, but not by much. The word "idea" appears list of 850 common words: https://en.wiktionary.org/wiki/Appendix:Basic_English_w
by kazinator 5y ago
I would say it has better entropy, but not by much.
The word "idea" appears list of 850 common words:
https://en.wiktionary.org/wiki/Appendix:Basic_English_word_list https://en.wiktionary.org/wiki/Appendix:Basic_English_word_l...
"fish" is ranked #1453 in the list of lemmas linked from here:
https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists#Top_English_words_lists https://en.wiktionary.org/wiki/Wiktionary:Frequency_lists#To...
We can arithmetically encode the choice of two words from dictionaries of 1000 and 1500, respectively, using 21 bits.
The two bits estimate is a somewhat pessimistic lower bound.