4 ms·

I tried with an oncologist who uses GPT ~daily. It frequently gives outdated answers that violate standard of care. No way to know which sentences are the wron

I tried with an oncologist who uses GPT ~daily. It frequently gives outdated answers that violate standard of care. No way to know which sentences are the wrong ones. The result is every fact must be searched again manually anyways. There is no time saving, and on its own, literally criminal advice. She still uses it for tasks like rewriting emails for tone. But not anything to do with getting medical knowledge. This should not be surprising to anyone who has used these. Tasks where users can self-validate and riff, like writing and coding, are great. But medical knowledge Q&A would need something like links back to current sources for every tidbit for it to be in this camp.

nradov 4y ago
Never mind complicated fields like oncology, ChatGPT gets even basic medical stuff wrong like treatment for minor sports injuries. If you ask it whether ice is an effective treatment it will basically answer yes, and give a long list of reasons why. This is unsurprising since there are so many web pages still recommending the outdated RICE (rest, ice, compression, elevation) protocol. But it turns out that protocol was never based on any reliable scientific evidence and in most cases likely does more harm than good. https://www.drmirkin.com/fitness/why-ice-delays-recovery.html https://www.drmirkin.com/fitness/why-ice-delays-recovery.htm... https://wwnorton.com/books/Good-to-Go/ https://wwnorton.com/books/Good-to-Go/ ChatGPT gives medical advice based on popularity, not scientific accuracy.