That type of test (have someone pushing ChatGPT to say that vitamins are good for you) would be more relevant than testing an LLM on its ability to recognize sy

That type of test (have someone pushing ChatGPT to say that vitamins are good for you) would be more relevant than testing an LLM on its ability to recognize symptom keywords and match diagnostics, something that everyone (including their harshest critics) readily admit they can do. The “MedMD problem” is so classic that a comment next to this one doesn’t have to explain why you always end up with cancer. And the supplement industry pushing PragmaticPulp’s friends’ delusion isn’t exactly discrete either. All that, while every Western nation has record levels of low physical activity and social isolation: there is a real mismatch between medical advice to civilians and what those tools offer. A convenient, accessible medical dictionary is great, and I have no doubt it can process even more specialized knowledge, given enough strong-arming Epic (the de-facto monopoly on doctor’s note software) and a sprinkle of data engineering. However, that’s not the most apparent issue that this tool has. I’m concerned that OpenAI isn’t more focused on the bigger problem.