I've heard similar stories involving ChatGPT. I believe at least some of them. Why not? ERs are known to misdiagnose patients who end up having serious conditio

I've heard similar stories involving ChatGPT. I believe at least some of them. Why not? ERs are known to misdiagnose patients who end up having serious conditions; there are examples of this exact scenario (misdiagnosed appendicitis as a stomach bug). It's also known that Google searching symptoms will pull up serious diseases, which someone with said symptoms may or may not actually have, so an LLM also will. Ultimately, effectively diagnosing patients from descriptions is impossible, because two can give the same description, where one has a mild condition and the other serious. More tests would resolve most ambiguity, but most ERs are too overworked, so you only get more tests if you really advocate for yourself (and/or are rich). A stomach bug can have nearly the same symptoms as the initial stages of appendicitis, and Grok (allegedly) told OP he needs to advocate for a CT. I do see an issue, where LLMs tell too many people they have a serious condition and must go to the ER and order unnecessary tests, where a doctor would say to those people "you're fine" and they really are fine. People would end up anxious and angry at doctors over nothing, and ERs would end up overwhelmed with so many spurious tests and requests, that they would miss necessary ones. I say "would" but this situation has already started, except it's Google that is telling people to panic. Ultimately, there are too many people and not enough doctors and equipment (and too many tests may itself be unhealthy), so people who may have serious conditions aren't tested for them. I don't know the solution, but do want to point out, with people saying LLMs will replace mass sections of the workforce; why don't we as a society train more nurses and doctors?