5 ms·

This is exactly the problem we have been working on at the startup I founded, Outcomes.com. As a physician and training surgeon before moving out to the Bay Are

This is exactly the problem we have been working on at the startup I founded, Outcomes.com. As a physician and training surgeon before moving out to the Bay Area, I was amazed that we had very poor visibility and almost no data on how our patients did after treatments beside very crude measures, like whether the patient had major complications or died. Our focus has been on capturing patient-reported outcomes - that is the outcome of care as experienced by the patient, measured using objective and validated surveys that are often specific to the condition or treatment. There is now a movement among payers and Medicare to incorporate these kind of patient-centered outcome measures in to reimbursement, although change is admittedly slow. I'd love to talk to people wanting to make an impact in this field, my email address is francis at outcomes.com

nradov 9y ago
Perhaps I'm missing something, but how could patient-reported outcomes possibly be objective? Patients are notoriously bad at assessing their own conditions and establishing causality for changes. We know that patients tend to give positive survey results if the physician was "nice" and if he wrote a prescription, regardless of actual quality of care.
- packeted 9y ago
  Most patient-reported outcome measures are designed to provide an objective assessment of a patient's health status, for example in urology many of the surveys ask specific questions about urinary symptoms, eg. how many times did you have to get up in the night to urinate, or in orthopedics whether you had difficulty performing specific tasks related to your joint. Some aspects are always going to be subjective (eg. impact on quality of life or pain) and IMHO that's OK and we should absolutely attempt to measure them, not least because that information could help inform the treatment itself. Also, by measuring the changes in response over time for a patient, you can attempt to control for individual biases. I agree that patient satisfaction surveys (in the UK, categorized as patient reported experience measures) can be very prone to bias and while important, are not necessarily correlated with outcomes.
  - nradov 9y ago
    The trouble with that is it doesn't establish causality. Did the patient's symptoms improve because of the provider's intervention or in spite of it? Plus you can't force patients to respond to the survey so there's no way to know if you have a representative sample. In my subjective experience, patients that are happy and improving are more likely to answer those questions than patients who are unhappy and ill.
    - Retric 9y ago
      X people per hour for over a few years averages out much random noise. Even surgeons see on average multiple people per day over a few years which is still recent enough to be relevant.
      - nradov 9y ago
        No it doesn't average out at all due to persistent differences in patient populations across providers which can't be adequately controlled for using the available data.
        Retric 9y ago
        You misunderstand. You have a representative sample of the patients seen by that doctor. Individual differences like patient weight may be very important at the individual level, but across a thousands of people that's far less important than the overall differences across populations.
        nradov 9y ago
        No that's simply not how it works and won't give you an accurate picture of quality differences between providers. I don't know how to make it any more clear.
        Retric 9y ago
        Comparisons between providers is a separate issue. Suppose you assigned people randomly to 101 doctors from 2 populations (A,B). Now suppose A was 10x as likely to die. D(0) get's 0% of A's and 100% B's. D(1) is 1A and 99B. All the way to D(100) that only get's B's. In that admittedly simplified example you could determine that D(0) did a better job than D(100) by only getting 8x as many deaths even if 9.8x may be statistically irrelevant. Yes, the real world is vastly more complex. But, while that may make a strict ordering impossible you can likely find out the best doctor is likely in the top quarter and the worst doctor very likely in the bottom quarter, which can be useful. Picture a score card that said 80% chance in (0% - 20%], 15% chance in the (25%-50%], etc. That's not exactly meaningless information.
neuro_imager 9y ago
Few initiatives are as bad as they sound as PROMS (patient reported outcomes). Very good for people who like power lunches, excel spreadsheets and having numbers to vocalize - worse than useless for patients and physicians.

nradov 9y ago

Perhaps I'm missing something, but how could patient-reported outcomes possibly be objective? Patients are notoriously bad at assessing their own conditions and establishing causality for changes. We know that patients tend to give positive survey results if the physician was "nice" and if he wrote a prescription, regardless of actual quality of care.

packeted 9y ago
Most patient-reported outcome measures are designed to provide an objective assessment of a patient's health status, for example in urology many of the surveys ask specific questions about urinary symptoms, eg. how many times did you have to get up in the night to urinate, or in orthopedics whether you had difficulty performing specific tasks related to your joint. Some aspects are always going to be subjective (eg. impact on quality of life or pain) and IMHO that's OK and we should absolutely attempt to measure them, not least because that information could help inform the treatment itself. Also, by measuring the changes in response over time for a patient, you can attempt to control for individual biases. I agree that patient satisfaction surveys (in the UK, categorized as patient reported experience measures) can be very prone to bias and while important, are not necessarily correlated with outcomes.
- nradov 9y ago
  The trouble with that is it doesn't establish causality. Did the patient's symptoms improve because of the provider's intervention or in spite of it? Plus you can't force patients to respond to the survey so there's no way to know if you have a representative sample. In my subjective experience, patients that are happy and improving are more likely to answer those questions than patients who are unhappy and ill.
  - Retric 9y ago
    X people per hour for over a few years averages out much random noise. Even surgeons see on average multiple people per day over a few years which is still recent enough to be relevant.
    - nradov 9y ago
      No it doesn't average out at all due to persistent differences in patient populations across providers which can't be adequately controlled for using the available data.
      - Retric 9y ago
        You misunderstand. You have a representative sample of the patients seen by that doctor. Individual differences like patient weight may be very important at the individual level, but across a thousands of people that's far less important than the overall differences across populations.
        nradov 9y ago
        No that's simply not how it works and won't give you an accurate picture of quality differences between providers. I don't know how to make it any more clear.
        Retric 9y ago
        Comparisons between providers is a separate issue. Suppose you assigned people randomly to 101 doctors from 2 populations (A,B). Now suppose A was 10x as likely to die. D(0) get's 0% of A's and 100% B's. D(1) is 1A and 99B. All the way to D(100) that only get's B's. In that admittedly simplified example you could determine that D(0) did a better job than D(100) by only getting 8x as many deaths even if 9.8x may be statistically irrelevant. Yes, the real world is vastly more complex. But, while that may make a strict ordering impossible you can likely find out the best doctor is likely in the top quarter and the worst doctor very likely in the bottom quarter, which can be useful. Picture a score card that said 80% chance in (0% - 20%], 15% chance in the (25%-50%], etc. That's not exactly meaningless information.

neuro_imager 9y ago

Few initiatives are as bad as they sound as PROMS (patient reported outcomes). Very good for people who like power lunches, excel spreadsheets and having numbers to vocalize - worse than useless for patients and physicians.