3 ms·
It gets worse. The human answers were scraped from Reddit replies by verified doctors on r/AskDocs. It's an unfair test. Doctors don't normally provide care di
by iudqnolq 3y ago
It gets worse. The human answers were scraped from Reddit replies by verified doctors on r/AskDocs.
It's an unfair test. Doctors don't normally provide care directly to patients based on a few paragraph written description of your situation, and GPT was trained on Reddit.
I don't have access to the paper so I can't tell if they ensured their human answers are from before the GPT cutoff.