3 ms·
I suspect an ER doctor who misdiagnosed patients 50% of the time would not be an ER doctor for very long. Also consider that, in this case, the 50% the AI got
by kelnos 4y ago
I suspect an ER doctor who misdiagnosed patients 50% of the time would not be an ER doctor for very long.
Also consider that, in this case, the 50% the AI got right was defined such somewhat generously. For each patient, the AI presented several possible diagnoses, only one of which was correct. If the AI were making all the decisions, would the AI also decide to treat the correct ailment in all those cases? In an emergency situation, you may not have the opportunity to go back and try other options if you're wrong the first time.
- vidarh 4y agoBut it's also a ridiculous assessment. How much training material for ER doctors was in the training set? I wonder what my rate would be (having never done a single course in medicine)... It should be totally unsurprising that it produced bad results. That it got as much right is an indication there's a good chance you can do reasonably well by training a model with a lot of actual case studies.
- lerchmo 4y agoEven providing it with a tool to search and load its context with relevant training textbooks / papers.