4 ms·
> “It’s been a struggle to update, I’ll be honest,” said Dr. Mark Kris, Memorial Sloan Kettering’s lead Watson trainer. He noted that treatment guidelines for e
by hacker_9 9y ago
> “It’s been a struggle to update, I’ll be honest,” said Dr. Mark Kris, Memorial Sloan Kettering’s lead Watson trainer. He noted that treatment guidelines for every metastatic lung cancer patient worldwide recently changed in the course of one week after a research presentation at a cancer conference. “Changing the system of cognitive computing doesn’t turn around on a dime like that,” he said. “You have to put in the literature, you have to put in cases.”
Wow the way they describe Watson is just like a massive book of documentation, with some NLP functionality layered on top to interface with the doctors. Keeping the database up to date must be a huge undertaking. Also this:
> "Given the same clinical scenario, doctors can — and often do — disagree about the best course of action, whether to recommend surgery or chemotherapy, or another treatment. Those discrepancies are especially wide for second- and third-line treatments given after an initial therapy fails, where evidence of benefits is slimmer and consensus more elusive."
Having an expert doctors opinion hard coded into the machine sounds good, but it won't be as good as a doctor in the room who can pick up on all sorts of other cues that I'm not sure how'd you even type into a computer. Things like breathing patterns, reaction to tactile stimuli, fuzzy logic ('that hurts, that hurts more'), facial expressions and so on.
Seems like this project has a long way to go, to get to the standard the IBM marketing team are pretending it's already at.
- teknover 9y ago"He noted that treatment guidelines for every metastatic lung cancer patient worldwide recently changed in the course of one week after a research presentation at a cancer conference." Isn't this a good thing then that there's a digital assistant to ensure doctors are up-to-date and provide the right treatment plans?
- hacker_9 9y agoOf course, but in the very next sentence the doctor says the system stays out of date for quite a while. That's probably because they need an engineer to find all the old information and remove it, then input all the new information in whatever standard Watson requires.
- rscho 9y agoA digital assistant that signals guideline changes does not require advanced technology. This reflects failure of the medical system, more than anything else. Plus, the fact that guidelines change suddenly after some conference should tell you that treatment in the case depicted here is defined entirely on expert opinion. AI should seek to do better than just following expert opinion. Conclusion: the Watson system is a failure.