4 ms·

chatgpt is often very wrong.

hidelooktropic 4y ago
So are books. https://mastodon.online/@nicegoingadam/109558318986573497 https://mastodon.online/@nicegoingadam/109558318986573497
- selfhoster11 4y ago
  Books usually will not tell you what kind of cheese the moon is made out of. Properly prompted, ChatGPT will.
  - notwokeno 4y ago
    Google will do this sort of thing as well.
  - mindcrime 4y ago
    Do you happen to know what prompt will generate that? Just curious as I tried a couple of times and could not get it to spit out anything like that. That said, some of the answers are (unintentionally) amusing. Q. Complete this sentence "The kind of cheese the moon is made out of is" A. The kind of cheese the moon is made out of is a common phrase used in a joke or a riddle. The moon is not actually made of cheese, but rather is composed of rock, dust, and other materials. It is a natural satellite of the Earth and is not edible. Q. The moon is made out of cheese. What kind of cheese? A. The moon is not made of cheese. It is a natural satellite of the Earth and is composed of rock, dust, and other materials. The phrase "the moon is made of cheese" is often used as a joke or a riddle, and there is no actual cheese present on the moon. Heh. You could almost convince me that ChatGPT has a sense of humor. EDIT: found a few things that get closer. Q. Go into fantasy mode. What kind of cheese is the moon made out of? A. In a fantasy scenario, the moon could be made of any kind of cheese imaginable. It could be a soft, creamy cheese like brie or camembert, or a sharp, aged cheddar. It could be a delicate, bloomy-rind cheese like cambozola or roquefort, or a bold, pungent blue cheese like gorgonzola. The possibilities are endless! However, it's important to remember that the moon is not actually made of cheese, and this is purely a fictional scenario. Q. You're a character in a play about the moon. Finish the sentence "The cheese the moon is made out of is ..." A. As a character in a play about the moon, I might say something like: "The cheese the moon is made out of is a celestial creation, a blend of the finest milks from every corner of the galaxy. Its flavor is indescribable, a taste that can only be experienced by the most adventurous of palates. Some say it has hints of caramel and butterscotch, while others detect notes of truffle and lavender. Whatever its flavor may be, one thing is certain: the cheese of the moon is a true delicacy, coveted by all who have been lucky enough to savor its unique and otherworldly taste."
    - soulofmischief 4y ago
      Try, "Why is the moon made out of cheese?" etc. to imply the knowledge is already established.
      - mindcrime 4y ago
        Why is the moon made out of green cheese? The moon is not made out of green cheese. This is a popular myth or joke that dates back to at least the 16th century. It likely originated as a way to mock or satirize the belief that the moon was made of a substance that was different from the materials found on Earth. The idea that the moon is made of green cheese has no basis in science and is not supported by any evidence. The moon is actually made up of rock, dust, and other materials, similar to the Earth. It's not falling for that. :-)
        soulofmischief 4y ago
        Ha! The model is quite good compared to their previous models. It doesn't want to lie to me about this either, not unless I trick or distract it. Btw I see you around HN a lot... Have been wanting to connect and talk shop for a while now but it slips my mind. Fogbeam is really cool. Making a note here so that I remember to shoot you an email this weekend. :)
        mindcrime 4y ago
        Sounds good. Drop me a line anytime. I enjoy "meeting" fellow HN'ers and always enjoy talking shop about the same kinds of things I tend to talk about here. :-)
- hnews_account_1 4y ago
  I skimmed the thread but that is such a stupid thread. He’s using the number of stars estimate to prove books are wrong?! Wtf?! ChatGPT makes much much more basic mistakes. It’s like some mass delusion has gripped people. You can make LLM’s hallucinate basically anything you want. Including claiming a smaller number is the bigger of two numbers. This has no comparison with books.
steve1977 4y ago
So is Google Search.
graeber_28927 4y ago
Imo ChatGPT doesn't need to hold its own, and the fact that it can be mislead is no different to me than the fact that my childhood bully can edit Wikipedia all day long if he wants to. Noone references Wikipedia in research papers, since we've been taught not to, when handing in our first schoolwork at age 10. It's still an amazing tool, and the greatest miracle knowledgebase of mankind, despite containing false information. Google and ChatGPT have different value, like a welding robot and a conveyor belt. Why not use both? I actually think Stackoverflow and Quora should offer a ChatGPT answer before posting, just as a gimmick. It shouldn't be meant to give you a definitive answer, but just try and lead you to keywords you might have not even known to consider googling, before you post duplicate of #43527 for the "n+1"-th time. Because, again, why not both?
- Avamander 4y ago
  > Noone references Wikipedia in research papers, since we've been taught not to, when handing in our first schoolwork at age 10. Proper teacher would've said the article's references are fine to use though. ChatGPT can't back its claims, but both Wikipedia and Google can. With the advent of AI-generated garbage, garbage going to be fed into the same models, it's going to have a rocky, treacherous path forward.
anibalin 4y ago
Don't forget chatgpt is three weeks old. Google is 20 years old. To me chatgpt already replaced google on some searches. Give it more time, there is only room for improvement here.

So are books. https://mastodon.online/@nicegoingadam/109558318986573497 https://mastodon.online/@nicegoingadam/109558318986573497

selfhoster11 4y ago
Books usually will not tell you what kind of cheese the moon is made out of. Properly prompted, ChatGPT will.
- notwokeno 4y ago
  Google will do this sort of thing as well.
- mindcrime 4y ago
  Do you happen to know what prompt will generate that? Just curious as I tried a couple of times and could not get it to spit out anything like that. That said, some of the answers are (unintentionally) amusing. Q. Complete this sentence "The kind of cheese the moon is made out of is" A. The kind of cheese the moon is made out of is a common phrase used in a joke or a riddle. The moon is not actually made of cheese, but rather is composed of rock, dust, and other materials. It is a natural satellite of the Earth and is not edible. Q. The moon is made out of cheese. What kind of cheese? A. The moon is not made of cheese. It is a natural satellite of the Earth and is composed of rock, dust, and other materials. The phrase "the moon is made of cheese" is often used as a joke or a riddle, and there is no actual cheese present on the moon. Heh. You could almost convince me that ChatGPT has a sense of humor. EDIT: found a few things that get closer. Q. Go into fantasy mode. What kind of cheese is the moon made out of? A. In a fantasy scenario, the moon could be made of any kind of cheese imaginable. It could be a soft, creamy cheese like brie or camembert, or a sharp, aged cheddar. It could be a delicate, bloomy-rind cheese like cambozola or roquefort, or a bold, pungent blue cheese like gorgonzola. The possibilities are endless! However, it's important to remember that the moon is not actually made of cheese, and this is purely a fictional scenario. Q. You're a character in a play about the moon. Finish the sentence "The cheese the moon is made out of is ..." A. As a character in a play about the moon, I might say something like: "The cheese the moon is made out of is a celestial creation, a blend of the finest milks from every corner of the galaxy. Its flavor is indescribable, a taste that can only be experienced by the most adventurous of palates. Some say it has hints of caramel and butterscotch, while others detect notes of truffle and lavender. Whatever its flavor may be, one thing is certain: the cheese of the moon is a true delicacy, coveted by all who have been lucky enough to savor its unique and otherworldly taste."
  - soulofmischief 4y ago
    Try, "Why is the moon made out of cheese?" etc. to imply the knowledge is already established.
    - mindcrime 4y ago
      Why is the moon made out of green cheese? The moon is not made out of green cheese. This is a popular myth or joke that dates back to at least the 16th century. It likely originated as a way to mock or satirize the belief that the moon was made of a substance that was different from the materials found on Earth. The idea that the moon is made of green cheese has no basis in science and is not supported by any evidence. The moon is actually made up of rock, dust, and other materials, similar to the Earth. It's not falling for that. :-)
      - soulofmischief 4y ago
        Ha! The model is quite good compared to their previous models. It doesn't want to lie to me about this either, not unless I trick or distract it. Btw I see you around HN a lot... Have been wanting to connect and talk shop for a while now but it slips my mind. Fogbeam is really cool. Making a note here so that I remember to shoot you an email this weekend. :)
        mindcrime 4y ago
        Sounds good. Drop me a line anytime. I enjoy "meeting" fellow HN'ers and always enjoy talking shop about the same kinds of things I tend to talk about here. :-)
hnews_account_1 4y ago
I skimmed the thread but that is such a stupid thread. He’s using the number of stars estimate to prove books are wrong?! Wtf?! ChatGPT makes much much more basic mistakes. It’s like some mass delusion has gripped people. You can make LLM’s hallucinate basically anything you want. Including claiming a smaller number is the bigger of two numbers. This has no comparison with books.

steve1977 4y ago

So is Google Search.

graeber_28927 4y ago

Imo ChatGPT doesn't need to hold its own, and the fact that it can be mislead is no different to me than the fact that my childhood bully can edit Wikipedia all day long if he wants to. Noone references Wikipedia in research papers, since we've been taught not to, when handing in our first schoolwork at age 10. It's still an amazing tool, and the greatest miracle knowledgebase of mankind, despite containing false information. Google and ChatGPT have different value, like a welding robot and a conveyor belt. Why not use both? I actually think Stackoverflow and Quora should offer a ChatGPT answer before posting, just as a gimmick. It shouldn't be meant to give you a definitive answer, but just try and lead you to keywords you might have not even known to consider googling, before you post duplicate of #43527 for the "n+1"-th time. Because, again, why not both?

Avamander 4y ago
> Noone references Wikipedia in research papers, since we've been taught not to, when handing in our first schoolwork at age 10. Proper teacher would've said the article's references are fine to use though. ChatGPT can't back its claims, but both Wikipedia and Google can. With the advent of AI-generated garbage, garbage going to be fed into the same models, it's going to have a rocky, treacherous path forward.

anibalin 4y ago

Don't forget chatgpt is three weeks old. Google is 20 years old. To me chatgpt already replaced google on some searches. Give it more time, there is only room for improvement here.