3 ms·
Humans are not allowed to bring a single page cheat sheet let alone a snapshot copy of the internet with them into the testing facility when taking the USMLE, n
by ChainOfFools 4y ago
Humans are not allowed to bring a single page cheat sheet let alone a snapshot copy of the internet with them into the testing facility when taking the USMLE, nor any calculator with persistent memory or capable of solving anything more complicated than factoring a fourth degree polynomial (the most powerful calculator permitted, iirc, is a casio 991-ex). So I'm not sure this is even remotely a fair comparison unless humans are given access to the same resources.
That said, this exam as well as the MCAT and almost every stem oriented filtering system that we have is hopelessly outdated by the availability of both the internet as well as LLMs.
We're still filtering people based on how fast they can pretend to be a computer, as if the job they are pursuing involved frantically working out a system of pdes on the back of a napkin trying to land a 60s era fighter jet in the middle of a blackout thunderstorm without the aid of any electronic instrumentation. We, predictably graduate the best and brightest robots, or rather poor imitations of robots, as a result. This explains quite a lot of one's experience dealing with the majority of licensed medical professionals in the US.
- pulvinar 4y agoI'm not sure, but I doubt they let GPT-4 access the web (or a calculator) during the test. So in that sense it's fair. Outside the test both it and doctors would certainly have web access. But the test isn't really the important thing. If my life were hanging in the balance and it had a cure, I'd listen.