The first part of your statement feels like it's anthropomorphising GPT-4. GPT-4s response to learning that GPT-3 is bad at word play will to store the concept

The first part of your statement feels like it's anthropomorphising GPT-4. GPT-4s response to learning that GPT-3 is bad at word play will to store the concept of GPT-3 being bad at word play to recall if prompted about GPT-3 in future, not to swot up on word play. If you want GPT-4 to be better at word play you'll need a corpus of puns, rhymes and higher level concept association and a lot of training on replicating them and when to recognise a prompt might require them.