3 ms·

Having worked in clinical trialling, what I saw made me realise that the final stats may be worth much less because of mismanagement of data. I can give some h

Having worked in clinical trialling, what I saw made me realise that the final stats may be worth much less because of mismanagement of data. I can give some hare-raising examples[0] but for obvious reasons... The one I can give is it was known that docs who prescribed this to multiple patients and saw an apparent improvement the attributed to the new drug, would switch the patients on the old drug to the new and not inform us. Obviously they couldn't or they'd invalidate the trial and they knew it. And it was done entirely with the patient's best interests at heart. Docs care about their lives. That may have been rare and a flaw in the trial protocol, but much worse stuff was done via utter incompetence. And I mean including at the top of these giant drug companies. Run by idiots, really. Wider lesson: just cos you hand over a process to a third party does not mean it's going to be done right. [0] tribute to the thread elsewhere

bigfudge 7y ago
Switching extra patients to a new drug would make the trial more conservative though... so perhaps don’t worry so much. In general it’s worth remembering that RCTs are estimating the effect of an intention to treat ( the randomisation) not the treatment itself.
- tempguy9999 7y ago
  > ...would make the trial more conservative though... If the doc correctly divines that the drug is improving things, yes, but there is noise in the signal so it may be just noise causing the few apparent improvements the doc sees. If so, doc's action may be smothering a less-then-obvious signal. There's too much at stake for that to be acceptable. > ...are estimating the effect of an intention to treat ( the randomisation) not the treatment itself. I don't understand - the protocol applies the drug (aka the treatment) and results are measured. I don't understand 'intention to treat'. What is 'intention' here, so tech term I am not familiar with?
ZeikJT 7y ago
I think it's hilarious that in this one HN thread we have a complete word swap of terms. You said Hare when it should be Hair and they did the opposite. https://news.ycombinator.com/item?id=20682918 https://news.ycombinator.com/item?id=20682918 It's supposed to be hair-raising because it's alarming and surprising etc. Nothing to do with taking care of hares :)

bigfudge 7y ago

Switching extra patients to a new drug would make the trial more conservative though... so perhaps don’t worry so much. In general it’s worth remembering that RCTs are estimating the effect of an intention to treat ( the randomisation) not the treatment itself.

tempguy9999 7y ago
> ...would make the trial more conservative though... If the doc correctly divines that the drug is improving things, yes, but there is noise in the signal so it may be just noise causing the few apparent improvements the doc sees. If so, doc's action may be smothering a less-then-obvious signal. There's too much at stake for that to be acceptable. > ...are estimating the effect of an intention to treat ( the randomisation) not the treatment itself. I don't understand - the protocol applies the drug (aka the treatment) and results are measured. I don't understand 'intention to treat'. What is 'intention' here, so tech term I am not familiar with?

ZeikJT 7y ago

I think it's hilarious that in this one HN thread we have a complete word swap of terms. You said Hare when it should be Hair and they did the opposite. https://news.ycombinator.com/item?id=20682918 https://news.ycombinator.com/item?id=20682918 It's supposed to be hair-raising because it's alarming and surprising etc. Nothing to do with taking care of hares :)