This is not actually a test meant to be used on LLMs as the title implies. For one thing, any such test is tainted once it's published because it will end up in

This is not actually a test meant to be used on LLMs as the title implies. For one thing, any such test is tainted once it's published because it will end up in the training data. The title seems misleading. This is a thought experiment. Presenting the thought experiment to the model is not the same thing as "performing the experiment". In the experiment, the "octopus" has never seen English until it finds the telegraph. GPT on the other hand is already extensively trained on a huge amount of data which likely includes the thought experiment anyway.