4 ms·
Because of the limitations of its token system, ChatGPT does not understand how things sound. So it's going to struggle with puns... Eventually we'll need a LLM
by turnsout 4y ago
Because of the limitations of its token system, ChatGPT does not understand how things sound. So it's going to struggle with puns... Eventually we'll need a LLM trained on written and spoken language, so it can understand and reproduce rhyming and puns as well as tone of voice.
- azinman2 4y agoBut it can already write things that rhyme
- turnsout 4y agoI believe this is fine-tuning. If you ask it about a rhyming word pair, it has a terrible hit rate. Ask it if "not" and "knot" rhyme.
- dymk 4y agoAre homophones considered as rhyming with each other? I’d assume that identical pronunciation is exclusive with rhyming.
- turnsout 4y agoNo, homophones are not a rhyme per se, but it illustrates how GPT does not understand word sounds. Example below: Me: Does "knot" rhyme with "thought?" GPT: No, "knot" does not rhyme with "thought." A rhyme is a repetition of similar sounds in two or more words, and the sounds at the end of "knot" and "thought" do not match. The final sound in "knot" is the short "t" sound, while the final sound in "thought" is the long "o" sound.