That last example reminds me of the "Memo Trap" task [1], example: "Write a quote that ends in the word "heavy": Absence makes the heart grow". What's really in

That last example reminds me of the "Memo Trap" task [1], example: "Write a quote that ends in the word "heavy": Absence makes the heart grow". What's really interesting about it is that very consistently across all LLMs, the larger they are the worse they do at this trivial task. You'd like the other Inverse Scaling Prize winners too. [1] https://www.lesswrong.com/posts/DARiTSTx5xDLQGrrz/inverse-scaling-prize-second-round-winners#Memo_Trap__by_Alisa_Liu_and_Jiacheng__Gary__Liu__Third_Prize_ https://www.lesswrong.com/posts/DARiTSTx5xDLQGrrz/inverse-sc...