4 ms·

That's my feeling, but I have a friend who is a MD and an enthusiastic supporter of people getting medical info from LLMs...

monerozcash 10mo ago
Getting medical info from LLMs is great and can save your life. Blindly trusting medical info from LLMs is idiotic and can kill you. Pretty much any tool will be dangerous if misused.
- hansmayer 10mo ago
  > Getting medical info from LLMs is great and can save your life. No its not - LLMs are not medical experts. Nor are they experts for pretty much anything. They just extrapolate statistically the next token. If you fed them anti-vaxer information, theyd start recommending you to not get vaccinated so as to not obtain autism or something like that. We should not use them as experts on anything, much less so for medical information. On the other hand, if you want to use them to generate large amounts of text and images, sure go do that. They can do that I guess.
  - monerozcash 10mo ago
    > No its not - LLMs are not medical experts So what? That does not mean they're not very good at searching the internet and often provide useful information. > If you fed them anti-vaxer information, theyd start recommending you to not get vaccinated so as to not obtain autism or something like that. I specifically addressed this in the very short comment you're replying to, but I will repeat: >Blindly trusting medical info from LLMs is idiotic and can kill you.
    - hansmayer 10mo ago
      What does being good in searching Internet (I'll let slide the obvious issue of hallucinating URLs) have to do with medical expertise? At all? At least with WebMD the content did not change every time you visited the same page?
      - monerozcash 10mo ago
        What does medical expertise have to do with being able to provide useful information? AI has no expertise. > I'll let slide the obvious issue of hallucinating URLs That indeed was an issue, but I can't remember the last time I've encountered that now that agentic web browsing is everywhere. I guess the cheapest models might still be affected by that?
        hansmayer 10mo ago
        Well, I guess since you have not encountered it recently, then its fine... Everyone else is just using "cheapest" models ;)
        monerozcash 10mo ago
        No matter how badly the AI gets things wrong, it's fine. You're not supposed to trust it.
        hansmayer 10mo ago
        No its bloody not fine! We were told these were "Pocked-PhDs". The investment so far could have paid for a manned mission to Mars and back! The massive advertising campaigns absolutely try to subliminally influence us into believing these are trustworthy tools, while at the same team keeping that sneaky small print about "checking the answers". Whats the goddamn point then? If I cant trust them every single time, like I can with deterministic software, and they create more work for me, because now we have to double-check the shit that they spit out, how are they actually useful, beyond trivial use cases like producing stupid brainrot videos??

monerozcash 10mo ago

Getting medical info from LLMs is great and can save your life. Blindly trusting medical info from LLMs is idiotic and can kill you. Pretty much any tool will be dangerous if misused.

hansmayer 10mo ago
> Getting medical info from LLMs is great and can save your life. No its not - LLMs are not medical experts. Nor are they experts for pretty much anything. They just extrapolate statistically the next token. If you fed them anti-vaxer information, theyd start recommending you to not get vaccinated so as to not obtain autism or something like that. We should not use them as experts on anything, much less so for medical information. On the other hand, if you want to use them to generate large amounts of text and images, sure go do that. They can do that I guess.
- monerozcash 10mo ago
  > No its not - LLMs are not medical experts So what? That does not mean they're not very good at searching the internet and often provide useful information. > If you fed them anti-vaxer information, theyd start recommending you to not get vaccinated so as to not obtain autism or something like that. I specifically addressed this in the very short comment you're replying to, but I will repeat: >Blindly trusting medical info from LLMs is idiotic and can kill you.
  - hansmayer 10mo ago
    What does being good in searching Internet (I'll let slide the obvious issue of hallucinating URLs) have to do with medical expertise? At all? At least with WebMD the content did not change every time you visited the same page?
    - monerozcash 10mo ago
      What does medical expertise have to do with being able to provide useful information? AI has no expertise. > I'll let slide the obvious issue of hallucinating URLs That indeed was an issue, but I can't remember the last time I've encountered that now that agentic web browsing is everywhere. I guess the cheapest models might still be affected by that?
      - hansmayer 10mo ago
        Well, I guess since you have not encountered it recently, then its fine... Everyone else is just using "cheapest" models ;)
        monerozcash 10mo ago
        No matter how badly the AI gets things wrong, it's fine. You're not supposed to trust it.
        hansmayer 10mo ago
        No its bloody not fine! We were told these were "Pocked-PhDs". The investment so far could have paid for a manned mission to Mars and back! The massive advertising campaigns absolutely try to subliminally influence us into believing these are trustworthy tools, while at the same team keeping that sneaky small print about "checking the answers". Whats the goddamn point then? If I cant trust them every single time, like I can with deterministic software, and they create more work for me, because now we have to double-check the shit that they spit out, how are they actually useful, beyond trivial use cases like producing stupid brainrot videos??