4 ms·

IBM wants to use big data to predict heart disease long before it strikes

26 points by smanuel 13y ago

waterside81 13y ago
I work at a company that does applied machine learning and health care is the #1 source for prospective business. The hardest part isn't the analysis - it's getting good, valid data. Health care data is so sparsely collected, poorly structured (if at all) and the privacy issues surrounding gaining access are very strict (perhaps rightfully so). The key, as IBM is doing, if working with a large HMO or health care network who hopefully have switched to a sensible EMR and have built up a good amount of historical data on patients. I'd add one last key to getting this right isn't only the breadth of the data, but the depth. Knowing some superficial aspects of a person (age, weight, habits) is too naive. You need family history, you need psychosocial aspects (nightmares, trouble at work, marital problems etc.). If you can get that, then you're cooking.
- Pxtl 13y ago
  I work in public health research and we collect similar data. We do it the hard way: surveys. Surveys dozens upon dozens of pages long. Because of the logistics involved and the time it requires to get the info from participants, the data is filthy. I can see the appeal of trying to get it direct from the insurance companies/government.
- smanuel 13y ago
  Agree, the more data points we get access to, the more correct analysis we'll produce at the end. It's a pity knowing that there's a lot of information stored already in systems like 23andme, practice fusion, healthtap, etc. but I guess getting access to this data to aggregate it and analyze it would be... mission impossible.
- drcode 13y ago
  I'm also in this field and couldn't agree more. I hate to be a cynic, but the reason IBM is going down this road is almost purely because it allows them to capture a lot of poorly allocated health care resources (in essence, this is all about government rent seeking.)
  - lambersley 13y ago
    Being a former IBM'er, I can tell you this, there is nothing altruistic in their motives. They invest billions into research with plans to reap the rewards. Health informatics, in Canada is brutal to say the least. See eHealth disaster. IBM employs some really intelligent people who intent to capitalize on this situation.
    - drcode 13y ago
      To clarify my remarks, I don't really have a problem with a profit motive... my argument is more that you could make money from (1) coming up with better treatments and selling them or (2) extracting poorly allocated resources from the government. We need fewer health care projects that are the latter.
- elkman 13y ago
  I've worked on the problem of entering well modeled medical data for a decade and I have seen very slow improvement over that time. Not only is the overwhelming majority of medical data not in a proper data model, the data that is has most likely been subject to selective pressure (which will probably not be accounted for in most analyses). Once you have enough well structured data, the next challenge will be reducing the dimensionality taking into account the meaning of the data. The fact that a patient is diabetic, e.g., can be inferred from a specific diagnosis, a set of medications and several lab tests. It is a very promising field but I see non medical people entering it with a certain amount of cockiness.
drcode 13y ago
We need to start using all the big data muscle on basic research of cell chemistry, less on analysis of patient data. I could probably fit all well-structured data elements in existence for all medical patients in the US for a year on a single DVD. (and even the unstructured non-image data is pretty sparse.) This is not really a problem where "big data" techniques are the right tool- There's too little data. However, I believe we should be experimenting on cell cultures in laboratories at large scales. None of this is happening, I believe... no laboratory is running hundreds of thousands of cultures in parallel with carefully manipulated chemical environments and generating data from them. A data set generated from such cell culture analysis could be petabytes in size. With that type of data set I believe it would be possible, using big data techniques, to get a lot of rigorous and causative details of chemical cell pathways relevant to disease formation that we currently lack. This is the direction I think we need to be going. I certainly would love to be wrong and would love to get news that IBM has cracked heart disease with this new project. However, my guess is that this is a very inefficient way to apply big data techniques to cure diseases.
- ambiate 13y ago
  One of the main issues is that cellular analysis in the basement is nearly impossible. I could actually see this coming to life if hardware was in the hands of the correct person.
- bigwaff 13y ago
  "I could probably fit all well-structured data elements in existence for all medical patients in the US for a year on a single DVD." As someone who builds and supports a massive "big data" healthcare platform, I have to say you are horribly mistaken. Non-image well structured patient data, even if compressed, across all healthcare, with potentially multiple EMRs and data collection systems per healthcare organization, even if just the last years' worth of data, is "big data" and can benefit from "big data" techniques. Like all "big data" endeavors across any number of problem domains, health care application of "big data" is in its infancy. Will the use of "big data" techniques over patient data discover disease cures? I don't know. But there is gold in them there hills... what kind? We will have to wait to find out.
madaxe 13y ago
This, of course, has nothing to do with improving quality of life or preventing heart disease, but will have plenty to do with denying health insurance or increasing premiums.
pasbesoin 13y ago
For whose benefit? Speaking generally [1], as a patient in the U.S., I no longer believe it is for my (i.e. the patient's) benefit. This is the result of both reporting on the health care landscape that I've digested as well as repeated personal experience. The U.S. system is, at scale, profit-driven. Profit in general serves a purpose; however, in the U.S., it has superseded that of providing effective health care. In other words, in the U.S., it has become solely about short-term, private profit. Public good and longer term, societal benefit have been relegated to imagery. -- 1. meaning not as someone having the specific condition under consideration

26 points by smanuel 13y ago

I work at a company that does applied machine learning and health care is the #1 source for prospective business. The hardest part isn't the analysis - it's getting good, valid data. Health care data is so sparsely collected, poorly structured (if at all) and the privacy issues surrounding gaining access are very strict (perhaps rightfully so). The key, as IBM is doing, if working with a large HMO or health care network who hopefully have switched to a sensible EMR and have built up a good amount of historical data on patients. I'd add one last key to getting this right isn't only the breadth of the data, but the depth. Knowing some superficial aspects of a person (age, weight, habits) is too naive. You need family history, you need psychosocial aspects (nightmares, trouble at work, marital problems etc.). If you can get that, then you're cooking.

Pxtl 13y ago
I work in public health research and we collect similar data. We do it the hard way: surveys. Surveys dozens upon dozens of pages long. Because of the logistics involved and the time it requires to get the info from participants, the data is filthy. I can see the appeal of trying to get it direct from the insurance companies/government.
smanuel 13y ago
Agree, the more data points we get access to, the more correct analysis we'll produce at the end. It's a pity knowing that there's a lot of information stored already in systems like 23andme, practice fusion, healthtap, etc. but I guess getting access to this data to aggregate it and analyze it would be... mission impossible.
drcode 13y ago
I'm also in this field and couldn't agree more. I hate to be a cynic, but the reason IBM is going down this road is almost purely because it allows them to capture a lot of poorly allocated health care resources (in essence, this is all about government rent seeking.)
- lambersley 13y ago
  Being a former IBM'er, I can tell you this, there is nothing altruistic in their motives. They invest billions into research with plans to reap the rewards. Health informatics, in Canada is brutal to say the least. See eHealth disaster. IBM employs some really intelligent people who intent to capitalize on this situation.
  - drcode 13y ago
    To clarify my remarks, I don't really have a problem with a profit motive... my argument is more that you could make money from (1) coming up with better treatments and selling them or (2) extracting poorly allocated resources from the government. We need fewer health care projects that are the latter.
elkman 13y ago
I've worked on the problem of entering well modeled medical data for a decade and I have seen very slow improvement over that time. Not only is the overwhelming majority of medical data not in a proper data model, the data that is has most likely been subject to selective pressure (which will probably not be accounted for in most analyses). Once you have enough well structured data, the next challenge will be reducing the dimensionality taking into account the meaning of the data. The fact that a patient is diabetic, e.g., can be inferred from a specific diagnosis, a set of medications and several lab tests. It is a very promising field but I see non medical people entering it with a certain amount of cockiness.

drcode 13y ago

We need to start using all the big data muscle on basic research of cell chemistry, less on analysis of patient data. I could probably fit all well-structured data elements in existence for all medical patients in the US for a year on a single DVD. (and even the unstructured non-image data is pretty sparse.) This is not really a problem where "big data" techniques are the right tool- There's too little data. However, I believe we should be experimenting on cell cultures in laboratories at large scales. None of this is happening, I believe... no laboratory is running hundreds of thousands of cultures in parallel with carefully manipulated chemical environments and generating data from them. A data set generated from such cell culture analysis could be petabytes in size. With that type of data set I believe it would be possible, using big data techniques, to get a lot of rigorous and causative details of chemical cell pathways relevant to disease formation that we currently lack. This is the direction I think we need to be going. I certainly would love to be wrong and would love to get news that IBM has cracked heart disease with this new project. However, my guess is that this is a very inefficient way to apply big data techniques to cure diseases.

ambiate 13y ago
One of the main issues is that cellular analysis in the basement is nearly impossible. I could actually see this coming to life if hardware was in the hands of the correct person.
bigwaff 13y ago
"I could probably fit all well-structured data elements in existence for all medical patients in the US for a year on a single DVD." As someone who builds and supports a massive "big data" healthcare platform, I have to say you are horribly mistaken. Non-image well structured patient data, even if compressed, across all healthcare, with potentially multiple EMRs and data collection systems per healthcare organization, even if just the last years' worth of data, is "big data" and can benefit from "big data" techniques. Like all "big data" endeavors across any number of problem domains, health care application of "big data" is in its infancy. Will the use of "big data" techniques over patient data discover disease cures? I don't know. But there is gold in them there hills... what kind? We will have to wait to find out.

madaxe 13y ago

This, of course, has nothing to do with improving quality of life or preventing heart disease, but will have plenty to do with denying health insurance or increasing premiums.

pasbesoin 13y ago

For whose benefit? Speaking generally [1], as a patient in the U.S., I no longer believe it is for my (i.e. the patient's) benefit. This is the result of both reporting on the health care landscape that I've digested as well as repeated personal experience. The U.S. system is, at scale, profit-driven. Profit in general serves a purpose; however, in the U.S., it has superseded that of providing effective health care. In other words, in the U.S., it has become solely about short-term, private profit. Public good and longer term, societal benefit have been relegated to imagery. -- 1. meaning not as someone having the specific condition under consideration