4 ms·

The big issue with LLM is how can you trust the information it gives you? It could be flat out making all or some of it up.

kahmeal 2y ago
I mean that's one of the value propositions these folks have to weigh into their product offerings. At some point you either have a reputation for delivering accurate responses or not and that will dictate who uses it and how much they're willing to pay for it.
tokioyoyo 2y ago
It doesn’t take much effort to verify and cross reference check in most of the scenarios. But I have no idea how they will fight against LLM-optimized SEO-hell. Like I could see products flat out flying in the ads, hoping for LLMs to pick that up and suggest to users. Source of truth will matter even more.
- reaperducer 2y ago
  It doesn’t take much effort to verify and cross reference check in most of the scenarios. And yet people still drive into rivers because Google Maps tells them to. Never underestimate the power of "computers are never wrong."
  - tokioyoyo 2y ago
    How many times has that happened? Those cases make the headlines, but it’s so rare that, in my opinion, they can be disregarded. Nothing is perfect, just assess your risks and tolerance to error. That’s subjective, so one acts accordingly.
    - reaperducer 2y ago
      Once is enough. It's easy to disregard when it isn't you or someone you love. The rest of us were born with empathy.
      - tokioyoyo 2y ago
        It’s really not though. It goes back to the whole “at that point you shouldn’t drive/fly/cross the road because you might die” argument. Literally millions (billions?) people commute every day using navigation apps. There will be accidents, but so far it’s been statistically insignificant, so people keep using them. Everyone has their own risk tolerances.
happyopossum 2y ago
That's one of the things I like about the current implementation of Gemini - they seem to really be leaning in on grounding, and there are ref links for pretty much all of the stuff that I'd normally want to fact check form a chatbot.
scarface_74 2y ago
The built in web search https://chatgpt.com/share/67bf76e2-5124-8010-8f54-50d967625af4 https://chatgpt.com/share/67bf76e2-5124-8010-8f54-50d967625a...

kahmeal 2y ago

I mean that's one of the value propositions these folks have to weigh into their product offerings. At some point you either have a reputation for delivering accurate responses or not and that will dictate who uses it and how much they're willing to pay for it.

tokioyoyo 2y ago

It doesn’t take much effort to verify and cross reference check in most of the scenarios. But I have no idea how they will fight against LLM-optimized SEO-hell. Like I could see products flat out flying in the ads, hoping for LLMs to pick that up and suggest to users. Source of truth will matter even more.

reaperducer 2y ago
It doesn’t take much effort to verify and cross reference check in most of the scenarios. And yet people still drive into rivers because Google Maps tells them to. Never underestimate the power of "computers are never wrong."
- tokioyoyo 2y ago
  How many times has that happened? Those cases make the headlines, but it’s so rare that, in my opinion, they can be disregarded. Nothing is perfect, just assess your risks and tolerance to error. That’s subjective, so one acts accordingly.
  - reaperducer 2y ago
    Once is enough. It's easy to disregard when it isn't you or someone you love. The rest of us were born with empathy.
    - tokioyoyo 2y ago
      It’s really not though. It goes back to the whole “at that point you shouldn’t drive/fly/cross the road because you might die” argument. Literally millions (billions?) people commute every day using navigation apps. There will be accidents, but so far it’s been statistically insignificant, so people keep using them. Everyone has their own risk tolerances.

happyopossum 2y ago

That's one of the things I like about the current implementation of Gemini - they seem to really be leaning in on grounding, and there are ref links for pretty much all of the stuff that I'd normally want to fact check form a chatbot.

scarface_74 2y ago

The built in web search https://chatgpt.com/share/67bf76e2-5124-8010-8f54-50d967625af4 https://chatgpt.com/share/67bf76e2-5124-8010-8f54-50d967625a...