Ah, interesting. I didn't notice that. I have noticed that chatgpt is really impressive at doing rhyming poems/songs, and many of its generated poems sound simi

Ah, interesting. I didn't notice that. I have noticed that chatgpt is really impressive at doing rhyming poems/songs, and many of its generated poems sound similar to each other. I also don't remember raw gpt-3 being so good at poems. So I wonder if there was substantial fine-tuning for chatgpt specifically to reward it to generate poems, in a particular style. And here, it's "over indexing" on that and still generating poems in that familiar style