3 ms·

Modern LLMs routinely beat human doctors at diagnosing "extremely rare edge cases". They have unmatched breadth of knowledge by default, and can maintain atten

Modern LLMs routinely beat human doctors at diagnosing "extremely rare edge cases". They have unmatched breadth of knowledge by default, and can maintain attention across entire medical histories.

multjoy 4mo ago
Citation very much needed.
- fragmede 4mo ago
  https://www.reddit.com/r/ChatGPT/comments/1iz4iwm/chatgpt_is_a_shockingly_good_doctor/ https://www.reddit.com/r/ChatGPT/comments/1iz4iwm/chatgpt_is... or https://www.reddit.com/r/ChatGPT/comments/1oesnix/chatgpt_diagnosed_me_after_20_years/?solution=1070d7f6acaecd8e1070d7f6acaecd8e&js_challenge=1&token=7afd7253fec22262ff1c52b1703fe9ec8260e53ee96608169f498c1093e8a8fa&jsc_orig_r= https://www.reddit.com/r/ChatGPT/comments/1oesnix/chatgpt_di... or if you prefer from this site, https://news.ycombinator.com/item?id=43171639 https://news.ycombinator.com/item?id=43171639 and https://news.ycombinator.com/item?id=42999632 https://news.ycombinator.com/item?id=42999632 If you were looking for a published paper or something more official though, I don't have one.
  - moffkalast 4mo ago
    Maybe something that isn't completely censored anecdata? At best these fall into "well known diseases with obvious symptoms that overworked, incompetent, or simply sexist, human doctors missed" and not actual rare cases.
  - multjoy 4mo ago
    anecdotes aren't citations.
fn-mote 4mo ago
> Modern LLMs routinely beat human doctors at diagnosing "extremely rare edge cases". There is a selection bias here. Not saying it wouldn’t work, but right now you hear about exceptional cases, not when the LLM wants to amputate for a wart. We all work with LLMs, right? It hasn’t been long at all since an LLM gaslit me while attempting to recover an unbootable laptop. I should have been recommended a few simple steps to try; instead, it was unable to ignore the irrelevant details and led me on an hours-long chase. To me that means the LLM will also struggle to ignore irrelevant medical information.

Modern LLMs routinely beat human doctors at diagnosing "extremely rare edge cases". They have unmatched breadth of knowledge by default, and can maintain attention across entire medical histories.

multjoy 4mo ago

Citation very much needed.

fragmede 4mo ago
https://www.reddit.com/r/ChatGPT/comments/1iz4iwm/chatgpt_is_a_shockingly_good_doctor/ https://www.reddit.com/r/ChatGPT/comments/1iz4iwm/chatgpt_is... or https://www.reddit.com/r/ChatGPT/comments/1oesnix/chatgpt_diagnosed_me_after_20_years/?solution=1070d7f6acaecd8e1070d7f6acaecd8e&js_challenge=1&token=7afd7253fec22262ff1c52b1703fe9ec8260e53ee96608169f498c1093e8a8fa&jsc_orig_r= https://www.reddit.com/r/ChatGPT/comments/1oesnix/chatgpt_di... or if you prefer from this site, https://news.ycombinator.com/item?id=43171639 https://news.ycombinator.com/item?id=43171639 and https://news.ycombinator.com/item?id=42999632 https://news.ycombinator.com/item?id=42999632 If you were looking for a published paper or something more official though, I don't have one.
- moffkalast 4mo ago
  Maybe something that isn't completely censored anecdata? At best these fall into "well known diseases with obvious symptoms that overworked, incompetent, or simply sexist, human doctors missed" and not actual rare cases.
- multjoy 4mo ago
  anecdotes aren't citations.

fn-mote 4mo ago

> Modern LLMs routinely beat human doctors at diagnosing "extremely rare edge cases". There is a selection bias here. Not saying it wouldn’t work, but right now you hear about exceptional cases, not when the LLM wants to amputate for a wart. We all work with LLMs, right? It hasn’t been long at all since an LLM gaslit me while attempting to recover an unbootable laptop. I should have been recommended a few simple steps to try; instead, it was unable to ignore the irrelevant details and led me on an hours-long chase. To me that means the LLM will also struggle to ignore irrelevant medical information.