5 ms·

I work in this field (not directly on the ML, for the company born out of the winner of Camelyon16) and the last two years of progress has been amazing to watch

by whafro 8y ago

I work in this field (not directly on the ML, for the company born out of the winner of Camelyon16) and the last two years of progress has been amazing to watch. Tumor detection has become incredibly accurate, across basically every tissue/tumor type, and we're now making real progress on the next major goal: determining the best therapy for a given patient. It's a bit of a dirty secret in this space that pathologists have a pretty high error rate on a lot of these tasks — it's just tough work for human eyes to do literally hundreds of times every day. Applying computer vision techniques can not only improve accuracy and reproducibility over human assessment, but you can do types of analysis in seconds-to-minutes that would literally take years for a human. We're just scratching the surface. There are lots of ML challenges here, but just as many general tech/engineering/design challenges. So if you're interested in working on bringing work like this to the masses, we'd love to talk at PathAI.

poutrathor 8y ago
To give a counter point of view here, a close relative of mine is a pathologists. We talked a lot about this subject and so far he is unimpressed by the results. Moreover, it seems that the ability to provide fast (in seconds to minutes) analysis implies powerful computational ability and data network. Finally, the data acquisition right now takes more or less 20 to 45 minutes depending on the patient and the targeted area, which means the promised analysis quickness is not such a real pro. I trust that science, research and ongoing work will end up providing interesting results, but many many startups will burn their cash before being able to provide real world usage services. Like you said, there are LOTs of challenges here. Certainly not a "low hanging fruit", not that a profitable business either since most countries will squash costs anywhere they can because the health cost keeps growing, and a very difficult legal environment to deal with. However, I am very thankful for your hard work and will to push toward a better future for health.
- maxerickson 8y ago
  The "years for a human" implies a different context than rapid individual results.
- taneq 8y ago
  I thought the primary importance of machine vision for this kind of cancer screening was that it doesn't give so many false negatives due to fatigue? IIRC there was a study that went back over cancer patients' screening tests and found that most of them had failed to identify visible, diagnosable tumors well before their disease was actually identified.
  - raducu 8y ago
    A very important use case is that a lot of places don't have easy access to good diagnosticians, and software + hardware are easy to scale while humans, not so much.
- ihnorton 8y ago
  > Moreover, it seems that the ability to provide fast (in seconds to minutes) analysis implies powerful computational ability and data network. Finally, the data acquisition right now takes more or less 20 to 45 minutes depending on the patient and the targeted area, which means the promised analysis quickness is not such a real pro. In surgical pathology, the patient is still under surgery while a pathologist makes a rapid, preliminary diagnosis on fresh tissue. This can be done in under 10 minutes, but typically takes 20-30 in practice -- the bulk of which time is spent flash-freezing and sectioning. Pathologists have only a few minutes to review after prep, so any digital augmentation technology must run on the order of a few minutes to be of use in guiding the surgery. This guidance may be crucial because many tumors cannot be characterized ahead of time due to the lack of non-invasive diagnostic tools (the most promising is gene profiling of bloodborne cells, but that is very challenging due to low circulating concentrations). Tumor type and grade are a large factor in a surgeon’s aggressiveness-vs-risk calculation, and this is especially true in brain tumors where cognitive damage poses a quality-of-life risk which must be weighed against potential survival gains. (not a pathologist, but I've done research, classifier, and software dev in the field -- very small, hands-on lab, so spent a huge amount of time in frozen section, OR, and with paths reviewing sections)
ska 8y ago
That's a bit of an optimistic take. For example, I'm familiar with a number of areas with the imaging community is getting much better at academic challenges, but the resulting models all generalize quite poorly. This has a lot to do with the lack of sufficient labeled data, but it doesn't help that the understanding of tumor morphology is changing pretty rapidly. It's true that screening is a particularly interesting application because of the issues of fatigue and low true positive rates. On the other hand, decades ago (i.e. well before deep learning approaches) we had clinically approved classifiers that did better than average radiologists for some of these tasks and the uptake still hasn't been that impressive. Lot's of non-technical issues around making stuff like this standard of care.
- whafro 8y ago
  I'm definitely an optimist about this, and I have an interest in it. So, grains of salt. But things worth noting: The lack of labeled data is definitely a challenge, as you call out. But a sizable chunk of what we do is power a platform and network of pathologists to get this data within hours for training purposes. We think there will always be a very real need for human pathologists, but that the bread-and-butter work in pathology can be better handled by well-trained and thoroughly-validated algorithms. And yeah, the non-technical issues are just as important as the technical ones: * There's very limited use of digital imagery in clinical pathology at all. Fortunately, that's not the case in research pathology, and the success we've had in that field has been moving clinical labs toward an investment in digital pathology. * Reimbursement (in the US) will be an issue. There are only a few options for billing payers for pathology reads, and they aren't necessarily in lock-step with the potential future of the industry. * Like I mentioned, this opens up a class of analysis that just isn't feasible for humans to perform. It's up to us to show the value of this type of analysis. * The regulatory environment is a real thing. We aren't hiding from this, and are creating processes that allow us to build and iterate software like we'd like to, while still faithfully meeting our regulatory burden. So far, we've found our approach to be viable, and we've had some really strong early results with our customers (and solid revenue!). So I'm pretty optimistic, for sure.
  - ska 8y ago
ccarter84 8y ago
Do you think as we continue to get better about detection, that we'll find an increasing array of slow-growing tumors present in much of the body? I.e. ones that may not need a full round of radiation / chemo for perhaps 5 years and perhaps more targeted approaches can be deployed? Just something i've been wondering about since I've got cancer on both sides of family and have been pondering doing full-body scans (which still seem quick excessive on the risk/reward)

by whafro 8y ago

poutrathor 8y ago

To give a counter point of view here, a close relative of mine is a pathologists. We talked a lot about this subject and so far he is unimpressed by the results. Moreover, it seems that the ability to provide fast (in seconds to minutes) analysis implies powerful computational ability and data network. Finally, the data acquisition right now takes more or less 20 to 45 minutes depending on the patient and the targeted area, which means the promised analysis quickness is not such a real pro. I trust that science, research and ongoing work will end up providing interesting results, but many many startups will burn their cash before being able to provide real world usage services. Like you said, there are LOTs of challenges here. Certainly not a "low hanging fruit", not that a profitable business either since most countries will squash costs anywhere they can because the health cost keeps growing, and a very difficult legal environment to deal with. However, I am very thankful for your hard work and will to push toward a better future for health.

maxerickson 8y ago
The "years for a human" implies a different context than rapid individual results.
taneq 8y ago
I thought the primary importance of machine vision for this kind of cancer screening was that it doesn't give so many false negatives due to fatigue? IIRC there was a study that went back over cancer patients' screening tests and found that most of them had failed to identify visible, diagnosable tumors well before their disease was actually identified.
- raducu 8y ago
  A very important use case is that a lot of places don't have easy access to good diagnosticians, and software + hardware are easy to scale while humans, not so much.
ihnorton 8y ago
> Moreover, it seems that the ability to provide fast (in seconds to minutes) analysis implies powerful computational ability and data network. Finally, the data acquisition right now takes more or less 20 to 45 minutes depending on the patient and the targeted area, which means the promised analysis quickness is not such a real pro. In surgical pathology, the patient is still under surgery while a pathologist makes a rapid, preliminary diagnosis on fresh tissue. This can be done in under 10 minutes, but typically takes 20-30 in practice -- the bulk of which time is spent flash-freezing and sectioning. Pathologists have only a few minutes to review after prep, so any digital augmentation technology must run on the order of a few minutes to be of use in guiding the surgery. This guidance may be crucial because many tumors cannot be characterized ahead of time due to the lack of non-invasive diagnostic tools (the most promising is gene profiling of bloodborne cells, but that is very challenging due to low circulating concentrations). Tumor type and grade are a large factor in a surgeon’s aggressiveness-vs-risk calculation, and this is especially true in brain tumors where cognitive damage poses a quality-of-life risk which must be weighed against potential survival gains. (not a pathologist, but I've done research, classifier, and software dev in the field -- very small, hands-on lab, so spent a huge amount of time in frozen section, OR, and with paths reviewing sections)

ska 8y ago

That's a bit of an optimistic take. For example, I'm familiar with a number of areas with the imaging community is getting much better at academic challenges, but the resulting models all generalize quite poorly. This has a lot to do with the lack of sufficient labeled data, but it doesn't help that the understanding of tumor morphology is changing pretty rapidly. It's true that screening is a particularly interesting application because of the issues of fatigue and low true positive rates. On the other hand, decades ago (i.e. well before deep learning approaches) we had clinically approved classifiers that did better than average radiologists for some of these tasks and the uptake still hasn't been that impressive. Lot's of non-technical issues around making stuff like this standard of care.

whafro 8y ago
I'm definitely an optimist about this, and I have an interest in it. So, grains of salt. But things worth noting: The lack of labeled data is definitely a challenge, as you call out. But a sizable chunk of what we do is power a platform and network of pathologists to get this data within hours for training purposes. We think there will always be a very real need for human pathologists, but that the bread-and-butter work in pathology can be better handled by well-trained and thoroughly-validated algorithms. And yeah, the non-technical issues are just as important as the technical ones: * There's very limited use of digital imagery in clinical pathology at all. Fortunately, that's not the case in research pathology, and the success we've had in that field has been moving clinical labs toward an investment in digital pathology. * Reimbursement (in the US) will be an issue. There are only a few options for billing payers for pathology reads, and they aren't necessarily in lock-step with the potential future of the industry. * Like I mentioned, this opens up a class of analysis that just isn't feasible for humans to perform. It's up to us to show the value of this type of analysis. * The regulatory environment is a real thing. We aren't hiding from this, and are creating processes that allow us to build and iterate software like we'd like to, while still faithfully meeting our regulatory burden. So far, we've found our approach to be viable, and we've had some really strong early results with our customers (and solid revenue!). So I'm pretty optimistic, for sure.
- ska 8y ago

ccarter84 8y ago

Do you think as we continue to get better about detection, that we'll find an increasing array of slow-growing tumors present in much of the body? I.e. ones that may not need a full round of radiation / chemo for perhaps 5 years and perhaps more targeted approaches can be deployed? Just something i've been wondering about since I've got cancer on both sides of family and have been pondering doing full-body scans (which still seem quick excessive on the risk/reward)