3 ms·
This is slightly tangential, but I just realized in reading that article that the JAMA paper on AI besting physicians with regard to empathetic responses was ba
by derbOac 4y ago
This is slightly tangential, but I just realized in reading that article that the JAMA paper on AI besting physicians with regard to empathetic responses was based on ratings of empathy provided by physicians? Not patients themselves, or providers actually trained in empathy as a core skill, like psychologists?
There's some irony there and it makes me wonder about the study.
I guess more to the point of the article it's maybe not surprising AI rollout is a hot mess given all the problems with healthcare at multiple levels. Like the pandemic, it seems like it just becomes a reflection or test of all the problems involved in the system as a whole.
- iudqnolq 4y agoIt gets worse. The human answers were scraped from Reddit replies by verified doctors on r/AskDocs. It's an unfair test. Doctors don't normally provide care directly to patients based on a few paragraph written description of your situation, and GPT was trained on Reddit. I don't have access to the paper so I can't tell if they ensured their human answers are from before the GPT cutoff.