33 ms·

I had to read that 3-4 times before I understood that it was a riddle. So I put it in GPT3–and it got the answer right away: “Mike's mother had 4 kids; 3 of th

I had to read that 3-4 times before I understood that it was a riddle. So I put it in GPT3–and it got the answer right away: “Mike's mother had 4 kids; 3 of them are named Luis, Drake and Matilda. What is the name of the 4th kid? The fourth kid is Mike.” So, maybe they just needed to try again.

labrador 4y ago
It's not a riddle because the answer is plain to anyone who understands English. I'm not saying you don't but the answer is right there. I asked it a followup: The name of the 4th child is in the question Ah, I see! My apologies for missing that. In that case, the name of the fourth child is Mike.
- dr_dshiv 4y ago
  I had to read it multiple times before I understood why it was a test of understanding. It is a riddle.
  - aPoCoMiLogin 4y ago
    even if you classify it as riddle, you still need intelligence to "solve it", which is what is missing in LLM. the good answer you later got was probably prompt created by someone manually, to further feed the model. did you need more data to solve the riddle ? rather more attention to what you read than more data, and that's the sole issue with AI/ML in current form.
    - labrador 4y ago
      Q: A week back I had a weak back. What should I do? A: Something went wrong, please try reloading the conversation I couldn't get ChatGPT to answer despite multiple tries. It answers simpler questions just fine
vidarh 4y ago
I've tried a bunch of riddles, and it often cops out and refuses to try, but you can nudge it by telling it is a riddle and trying to nudge it. Sometimes you need to lead it a bit the way you might with a human who can't find a strategy to work their way through. This doesn't seem too different from dealing with people to me. It might not be all that smart, but if you try leading it through riddles step by step it's if anything harder to dismiss its ability to reason and understand - spitting out an answer wholesale might just demonstrate recall. Being able to talk through the steps, and getting it when you suggest it answer a sub-problem first, is of anything more impressive to me.
foogazi 4y ago
Where’s the article about this example ?

labrador 4y ago

It's not a riddle because the answer is plain to anyone who understands English. I'm not saying you don't but the answer is right there. I asked it a followup: The name of the 4th child is in the question Ah, I see! My apologies for missing that. In that case, the name of the fourth child is Mike.

dr_dshiv 4y ago
I had to read it multiple times before I understood why it was a test of understanding. It is a riddle.
- aPoCoMiLogin 4y ago
  even if you classify it as riddle, you still need intelligence to "solve it", which is what is missing in LLM. the good answer you later got was probably prompt created by someone manually, to further feed the model. did you need more data to solve the riddle ? rather more attention to what you read than more data, and that's the sole issue with AI/ML in current form.
  - labrador 4y ago
    Q: A week back I had a weak back. What should I do? A: Something went wrong, please try reloading the conversation I couldn't get ChatGPT to answer despite multiple tries. It answers simpler questions just fine

vidarh 4y ago

I've tried a bunch of riddles, and it often cops out and refuses to try, but you can nudge it by telling it is a riddle and trying to nudge it. Sometimes you need to lead it a bit the way you might with a human who can't find a strategy to work their way through. This doesn't seem too different from dealing with people to me. It might not be all that smart, but if you try leading it through riddles step by step it's if anything harder to dismiss its ability to reason and understand - spitting out an answer wholesale might just demonstrate recall. Being able to talk through the steps, and getting it when you suggest it answer a sub-problem first, is of anything more impressive to me.

foogazi 4y ago

Where’s the article about this example ?