6 ms·

MIT AI tool can predict breast cancer up to 5 years early

127 points by codermobile 7y ago

melling 7y ago
According to Craig Venter, early detection is what we need to eliminate cancer: https://youtu.be/iUqgTYbkHP8?t=15m37s https://youtu.be/iUqgTYbkHP8?t=15m37s The reason most people die from pancreatic cancer, for example, is because we almost always detect it in a late stage.
- vharuck 7y ago
  According to the CDC [0], the five-year net survival rate for localized pancreatic cancer is 37.4%. That's really low for an early-staged diagnosis. By comparison, early-staged colorectal cancer has an 89.9% net survival rate, despite the late-staged rate being 14.2%. Granted, a small proportion of these cancers are caught an early stage. But I wouldn't say most people diagnosed would live five years longer if they'd caught it early. And that's ignoring lead-time bias [1]. [0] https://seer.cancer.gov/statfacts/html/pancreas.html https://seer.cancer.gov/statfacts/html/pancreas.html [1] https://en.m.wikipedia.org/wiki/Lead_time_bias https://en.m.wikipedia.org/wiki/Lead_time_bias
- yvsong 7y ago
  Early diagnosis is much better than late diagnosis. Prevention with a healthy life style is even better.
- skybrian 7y ago
  This depends on the type of cancer. In the case of a slow-growing cancer like prostate cancer, early detection can find cancers that would never be a problem (you'll die of something else first). This has to be taken into account when deciding how much screening to do.
  - melling 7y ago
    Not really. You’re probably still better off knowing you have the slow-growing benign prostrate cancer that you can monitor but not treat. Also, you might find you have the more aggressive form. https://www.webmd.com/prostate-cancer/prostate-cancer-survival-rates-what-they-mean https://www.webmd.com/prostate-cancer/prostate-cancer-surviv...
    - skybrian 7y ago
      Maybe the problem is that people don't do that? What do you think of this meta-analysis? "Pooled data currently demonstrates no significant reduction in prostate cancer-specific and overall mortality. Harms associated with PSA-based screening and subsequent diagnostic evaluations are frequent, and moderate in severity. Overdiagnosis and overtreatment are common and are associated with treatment-related harms." [...] "Screening resulted in a range of harms that can be considered minor to major in severity and duration. Common minor harms from screening include bleeding, bruising and short-term anxiety. Common major harms include overdiagnosis and overtreatment, including infection, blood loss requiring transfusion, pneumonia, erectile dysfunction, and incontinence. Harms of screening included false-positive results for the PSA test and overdiagnosis (up to 50% in the ERSPC study). Adverse events associated with transrectal ultrasound (TRUS)-guided biopsies included infection, bleeding and pain." https://www.cochrane.org/CD004720/PROSTATE_screening-for-prostate-cancer https://www.cochrane.org/CD004720/PROSTATE_screening-for-pro...
      - melling 7y ago
        many people also insist on getting antibiotics when they have a viral infection. We have a more measles cases now than a decade ago because of fake news. You might be right that many people would be better off not knowing but I’d rather we took a step forwards than backwards.
- falcolas 7y ago
  Early detection of breast cancer has had little noticeable impact on the mortality rates of breast cancer. Instead, it's been observed that the improved treatments for all forms of cancer have been the cause of a decrease in breast cancer mortality rates. https://www.sciencedirect.com/science/article/pii/S2213538315000065 https://www.sciencedirect.com/science/article/pii/S221353831...
jszymborski 7y ago
Here's the paper in question. https://pubs.rsna.org/doi/full/10.1148/radiol.2019182716 https://pubs.rsna.org/doi/full/10.1148/radiol.2019182716
wccrawford 7y ago
Without information about false positives, this is just basically saying they wrote an algorithm that sometimes points out cancer early. But if it is only correct 1% of the time, nobody is going to listen to it. It'd do even less than the current "You really need to check for cancer!" statements that we already have. Edit: From the paper: > A deep learning (DL) mammography-based model identified women at high risk for breast cancer and placed 31% of all patients with future breast cancer in the top risk decile compared with only 18% by the Tyrer-Cuzick model (version 8). So better than before, but still only detects 31%. If I'm reading correctly, it's 95% correct? I guess that means 5% false positives? That wouldn't be bad.
- deleted 7y ago
  [deleted]
- b_tterc_p 7y ago
  95% on a 1 in 1000 event means that over 1,000,000 trials 950 true positives ~50,000 false positives False positive breast cancer is pretty bad.
  - magwa101 7y ago
    Cost of false positive is retest and observe, this seems like a very low cost. Also, stop consuming sugar.
    - timthorn 7y ago
      What about the anxiety and distress caused to the patient? How many might undergo an unnecessary mastectomy to be on the safe side?
      - colechristensen 7y ago
        I have a problem with this vision. You can be told the risk factors for everybody, but when you are told the risk factors tailored to you it becomes dangerous? Should we tell everyone they're going to live forever so they live in ignorant bliss while healthy? I can see being unprepared for having that information, but I don't think the solution is not having the information.
b_tterc_p 7y ago
Addressing model bias by adjusting which data the model has access to is a bad idea. Tweaking the data so that the model output looks equitable is going to make your model across the board. You should train your model on what you have and then add explicit biases to the classifier for different groups. That way you have the best model and are clear on your biases. If this model is equally accurate for black and white women that means that either race is not a factor in predictability, that it is a factor but easily adaptable into a model, or race is a factor and they’ve reduced their ability to diagnose one group in the name of equity. The linked article suggests accuracy gains are due to better risk models, that use more than age. I’m not sure if that means it’s tied into the image neural net. Would like to see false positive rate too.
magwa101 7y ago
JFC this is great.
stakhanov 7y ago
I wish they would call it something other than AI. Like "Diagnostics" or if there MUST be a buzzword there, then call it "Predictive Diagnostics". Once upon a time, a necessary precondition to call something AI was that it should be something where there is at least the hope that it could one day generalize to pass the Turing test or something along those lines. Medical diagnostics is one of the primary applications of pattern processing, and since it's pretty damned impressive as it is, it's a bit pointless to try and make it even more impressive by suggesting that you might one day enjoy a chat with your medical diagnostic tool over breakfast, exchanging views on how the Knicks' season is shaping up... (Which both the informed readers, and the people writing this, know pretty damned well is never going to happen, and was never intended to happen).
aabaker99 7y ago
Take these results with a grain of salt. There's a large class imbalance in this dataset and ROC curves can be misleading in this case. The test set contains 269 positive examples and 8482 negative examples. From [1]: > Class imbalance can cause ROC curves to be poor visualiza- tions of classifier performance. For instance, if only 5 out of 100 individuals have the disease, then we would expect the five posi- tive cases to have scores close to the top of our list. If our classifier generates scores that rank these 5 cases as uniformly distributed in the top 15, the ROC graph will look good (Fig. 4a). However, if we had used a threshold such that the top 15 were predicted to be true, 10 of them would be FPs, which is not reflected in the ROC curve. This poor performance is reflected in the PR curve, however. The authors seem to be aware of this in the supplement and also evaluate performance by a hazard ratio they define: > We calculated the ratio of the observed cancer incidence in the top 10% of patients over the incidence in the middle 80% and referred to this metric as the top decile hazard ratio. We calculated the ratio of the observed cancer incidence in the bottom 10% of patients over the incidence in the middle 80% and referred to this metric as the bottom decile hazard ratio. However, binning is a form of p-hacking [2]. And I'm still wondering why they don't just post the Precision-Recall curves. [1] https://doi.org/10.1038/nmeth.3945 https://doi.org/10.1038/nmeth.3945 [2] https://doi.org/10.1080/09332480.2006.10722771 https://doi.org/10.1080/09332480.2006.10722771 [Edit] to add link to [2]
- ska 7y ago
  It's one of the difficulties with attacking screening applications where the population TPR is very low. For screening mammo, it's less than 1 in 1000.
brown123 7y ago
.. TESTIMONY OF HOW MY DAD GOT CURED FROM CANCER...... My name is Brown, my father has been suffering from cancer for over 3years, and the doctor told us that there is nothing he could do after doing 5 times chemotherapy and radiation and my father was not responding to treatment and not getting better.i was frustrated and confused and i started seeking advice from people until a friend told me about Dr. ALABI herbal medicines and cannabis oil and its fast curing ability of any kind of cancer and told me that her mother ovarian cancer was cured with the cannabis oil. I was desperate to save my father and i contacted Dr. ALABI via his email adress: dralabim5@gmail.com to get the miraculous oil. that was how the oil was sent to me through UPS Currier service. within 4days As i am writing this testimony on this Blog my father is so strong and healthy no more cancer in his cell blood again.my Father has been himself and i am so exicted of his fast recovery and with the help of this cannabis oil. What a miracle. My Father is now back alive, strong and healthy just within 3 weeks. We have gone for test and the doctor said there is no trace of cancer again in his body. you can also reach him via his whatsapp number:+2348155011610...Dr, ALABI CAN AS WELL CURE THE FOLLOWING DISEASES: 1. HIV/AIDS 2. HERPES 3. CANCER 4. ALS 5. Hepatitis B 6. Diabetes THANK YOU VERY MUCH FOR TAKING YOUR TIME TO READ THROUGH MY TESTIMONY

127 points by codermobile 7y ago

According to Craig Venter, early detection is what we need to eliminate cancer: https://youtu.be/iUqgTYbkHP8?t=15m37s https://youtu.be/iUqgTYbkHP8?t=15m37s The reason most people die from pancreatic cancer, for example, is because we almost always detect it in a late stage.

vharuck 7y ago
According to the CDC [0], the five-year net survival rate for localized pancreatic cancer is 37.4%. That's really low for an early-staged diagnosis. By comparison, early-staged colorectal cancer has an 89.9% net survival rate, despite the late-staged rate being 14.2%. Granted, a small proportion of these cancers are caught an early stage. But I wouldn't say most people diagnosed would live five years longer if they'd caught it early. And that's ignoring lead-time bias [1]. [0] https://seer.cancer.gov/statfacts/html/pancreas.html https://seer.cancer.gov/statfacts/html/pancreas.html [1] https://en.m.wikipedia.org/wiki/Lead_time_bias https://en.m.wikipedia.org/wiki/Lead_time_bias
yvsong 7y ago
Early diagnosis is much better than late diagnosis. Prevention with a healthy life style is even better.
skybrian 7y ago
This depends on the type of cancer. In the case of a slow-growing cancer like prostate cancer, early detection can find cancers that would never be a problem (you'll die of something else first). This has to be taken into account when deciding how much screening to do.
- melling 7y ago
  Not really. You’re probably still better off knowing you have the slow-growing benign prostrate cancer that you can monitor but not treat. Also, you might find you have the more aggressive form. https://www.webmd.com/prostate-cancer/prostate-cancer-survival-rates-what-they-mean https://www.webmd.com/prostate-cancer/prostate-cancer-surviv...
  - skybrian 7y ago
    Maybe the problem is that people don't do that? What do you think of this meta-analysis? "Pooled data currently demonstrates no significant reduction in prostate cancer-specific and overall mortality. Harms associated with PSA-based screening and subsequent diagnostic evaluations are frequent, and moderate in severity. Overdiagnosis and overtreatment are common and are associated with treatment-related harms." [...] "Screening resulted in a range of harms that can be considered minor to major in severity and duration. Common minor harms from screening include bleeding, bruising and short-term anxiety. Common major harms include overdiagnosis and overtreatment, including infection, blood loss requiring transfusion, pneumonia, erectile dysfunction, and incontinence. Harms of screening included false-positive results for the PSA test and overdiagnosis (up to 50% in the ERSPC study). Adverse events associated with transrectal ultrasound (TRUS)-guided biopsies included infection, bleeding and pain." https://www.cochrane.org/CD004720/PROSTATE_screening-for-prostate-cancer https://www.cochrane.org/CD004720/PROSTATE_screening-for-pro...
    - melling 7y ago
      many people also insist on getting antibiotics when they have a viral infection. We have a more measles cases now than a decade ago because of fake news. You might be right that many people would be better off not knowing but I’d rather we took a step forwards than backwards.
falcolas 7y ago
Early detection of breast cancer has had little noticeable impact on the mortality rates of breast cancer. Instead, it's been observed that the improved treatments for all forms of cancer have been the cause of a decrease in breast cancer mortality rates. https://www.sciencedirect.com/science/article/pii/S2213538315000065 https://www.sciencedirect.com/science/article/pii/S221353831...

jszymborski 7y ago

Here's the paper in question. https://pubs.rsna.org/doi/full/10.1148/radiol.2019182716 https://pubs.rsna.org/doi/full/10.1148/radiol.2019182716

wccrawford 7y ago

Without information about false positives, this is just basically saying they wrote an algorithm that sometimes points out cancer early. But if it is only correct 1% of the time, nobody is going to listen to it. It'd do even less than the current "You really need to check for cancer!" statements that we already have. Edit: From the paper: > A deep learning (DL) mammography-based model identified women at high risk for breast cancer and placed 31% of all patients with future breast cancer in the top risk decile compared with only 18% by the Tyrer-Cuzick model (version 8). So better than before, but still only detects 31%. If I'm reading correctly, it's 95% correct? I guess that means 5% false positives? That wouldn't be bad.

deleted 7y ago
[deleted]
b_tterc_p 7y ago
95% on a 1 in 1000 event means that over 1,000,000 trials 950 true positives ~50,000 false positives False positive breast cancer is pretty bad.
- magwa101 7y ago
  Cost of false positive is retest and observe, this seems like a very low cost. Also, stop consuming sugar.
  - timthorn 7y ago
    What about the anxiety and distress caused to the patient? How many might undergo an unnecessary mastectomy to be on the safe side?
    - colechristensen 7y ago
      I have a problem with this vision. You can be told the risk factors for everybody, but when you are told the risk factors tailored to you it becomes dangerous? Should we tell everyone they're going to live forever so they live in ignorant bliss while healthy? I can see being unprepared for having that information, but I don't think the solution is not having the information.

b_tterc_p 7y ago

Addressing model bias by adjusting which data the model has access to is a bad idea. Tweaking the data so that the model output looks equitable is going to make your model across the board. You should train your model on what you have and then add explicit biases to the classifier for different groups. That way you have the best model and are clear on your biases. If this model is equally accurate for black and white women that means that either race is not a factor in predictability, that it is a factor but easily adaptable into a model, or race is a factor and they’ve reduced their ability to diagnose one group in the name of equity. The linked article suggests accuracy gains are due to better risk models, that use more than age. I’m not sure if that means it’s tied into the image neural net. Would like to see false positive rate too.

magwa101 7y ago

JFC this is great.

stakhanov 7y ago

I wish they would call it something other than AI. Like "Diagnostics" or if there MUST be a buzzword there, then call it "Predictive Diagnostics". Once upon a time, a necessary precondition to call something AI was that it should be something where there is at least the hope that it could one day generalize to pass the Turing test or something along those lines. Medical diagnostics is one of the primary applications of pattern processing, and since it's pretty damned impressive as it is, it's a bit pointless to try and make it even more impressive by suggesting that you might one day enjoy a chat with your medical diagnostic tool over breakfast, exchanging views on how the Knicks' season is shaping up... (Which both the informed readers, and the people writing this, know pretty damned well is never going to happen, and was never intended to happen).

aabaker99 7y ago

Take these results with a grain of salt. There's a large class imbalance in this dataset and ROC curves can be misleading in this case. The test set contains 269 positive examples and 8482 negative examples. From [1]: > Class imbalance can cause ROC curves to be poor visualiza- tions of classifier performance. For instance, if only 5 out of 100 individuals have the disease, then we would expect the five posi- tive cases to have scores close to the top of our list. If our classifier generates scores that rank these 5 cases as uniformly distributed in the top 15, the ROC graph will look good (Fig. 4a). However, if we had used a threshold such that the top 15 were predicted to be true, 10 of them would be FPs, which is not reflected in the ROC curve. This poor performance is reflected in the PR curve, however. The authors seem to be aware of this in the supplement and also evaluate performance by a hazard ratio they define: > We calculated the ratio of the observed cancer incidence in the top 10% of patients over the incidence in the middle 80% and referred to this metric as the top decile hazard ratio. We calculated the ratio of the observed cancer incidence in the bottom 10% of patients over the incidence in the middle 80% and referred to this metric as the bottom decile hazard ratio. However, binning is a form of p-hacking [2]. And I'm still wondering why they don't just post the Precision-Recall curves. [1] https://doi.org/10.1038/nmeth.3945 https://doi.org/10.1038/nmeth.3945 [2] https://doi.org/10.1080/09332480.2006.10722771 https://doi.org/10.1080/09332480.2006.10722771 [Edit] to add link to [2]

ska 7y ago
It's one of the difficulties with attacking screening applications where the population TPR is very low. For screening mammo, it's less than 1 in 1000.

brown123 7y ago

.. TESTIMONY OF HOW MY DAD GOT CURED FROM CANCER...... My name is Brown, my father has been suffering from cancer for over 3years, and the doctor told us that there is nothing he could do after doing 5 times chemotherapy and radiation and my father was not responding to treatment and not getting better.i was frustrated and confused and i started seeking advice from people until a friend told me about Dr. ALABI herbal medicines and cannabis oil and its fast curing ability of any kind of cancer and told me that her mother ovarian cancer was cured with the cannabis oil. I was desperate to save my father and i contacted Dr. ALABI via his email adress: dralabim5@gmail.com to get the miraculous oil. that was how the oil was sent to me through UPS Currier service. within 4days As i am writing this testimony on this Blog my father is so strong and healthy no more cancer in his cell blood again.my Father has been himself and i am so exicted of his fast recovery and with the help of this cannabis oil. What a miracle. My Father is now back alive, strong and healthy just within 3 weeks. We have gone for test and the doctor said there is no trace of cancer again in his body. you can also reach him via his whatsapp number:+2348155011610...Dr, ALABI CAN AS WELL CURE THE FOLLOWING DISEASES: 1. HIV/AIDS 2. HERPES 3. CANCER 4. ALS 5. Hepatitis B 6. Diabetes THANK YOU VERY MUCH FOR TAKING YOUR TIME TO READ THROUGH MY TESTIMONY