As a large language model enjoyer I've been amazed how they are steadily reducing the number of bits needed to represent the next token in the sequence on avera

As a large language model enjoyer I've been amazed how they are steadily reducing the number of bits needed to represent the next token in the sequence on average. There is some irreducible amount of uncertainty they will reach eventually, but the trend isn't slowing down. The bonus is that as they have been reducing this number of bits with the models, they have been unlocking all of these amazing abilities of the LLMs like theory of mind and getting near human level on all these standardized tests. It's amazing to watch even if it eventually stops unlocking new powers.