I wonder how much of that is due to the task GPT-3 was trained for? Perhaps the "what to say" part is working perfectly, but what it wants to say is as generic

I wonder how much of that is due to the task GPT-3 was trained for? Perhaps the "what to say" part is working perfectly, but what it wants to say is as generic a text stream as possible. It already seems like GPT-3 has more "knowledge" than is obvious at first glance, but you need to prompt it correctly.