3 ms·
Doctors Are Not Trained to Think Critically
- PaulHoule 2y agoIt is one reason why LLMs do so well on medical exams. Doctors memorize stuff as opposed to derive it from first principles because the body is too complex to work from first principles. You’re supposed to prescribe a drug because it has been proven to work and approved, not because it should work in theory.
- klabb3 2y agoLLMs do not derive from first principles.
- PaulHoule 2y agoExactly. The doctors are memorizing. The answers are in medical textbooks that the system trained on and generalizing insofar as it turns knowledge written in sentences into answers to multiple choice questions.
- gus_massa 2y agoIt's a problem for medical research. During the covid pandemic, I read a lot of post here of preprints about miracle drugs like ivermectin and tried to find the error and make a comment. In most of the cases the level was very low with obvious errors.