This is exactly what I talked about in this post https://news.ycombinator.com/item?id=34445896 https://news.ycombinator.com/item?id=34445896 The reduced versio

This is exactly what I talked about in this post https://news.ycombinator.com/item?id=34445896 https://news.ycombinator.com/item?id=34445896 The reduced version is that decoder only transformer LLMs can not generate a hash of a random animal name followed by the animal name, they can only generate a random animal name followed by its hash (assuming the LLMs is powerful enough to compute hashes correctly in one forward pass in the first place).