There's a few things there that could be going on that seem more likely than "hardcoded". 1. The part of the network that does complex math and the part that w

There's a few things there that could be going on that seem more likely than "hardcoded". 1. The part of the network that does complex math and the part that write poetry are overlapping in strange ways. 2. Most of the models nowadays are assumed to be some mixture of experts. So it's possible that saying write the answer as a poem activates a different part of the model.