4 ms·
> That is, in let’s say a drug testing experiment, you give some people the drug and they recover. That doesn’t tell you much until you give some other people a
by gumby 5y ago
> That is, in let’s say a drug testing experiment, you give some people the drug and they recover. That doesn’t tell you much until you give some other people a placebo drug you know doesn’t work – but which they themselves believe in – and see how many of them recover. That number tells you how many people will recover whether the drug works or not. Unless people on your real drug do significantly better than people on the placebo drug, you haven’t found anything.
I had a drug program in which we blew away the standard placebo rate … unfortunately our placebo arm did too, though not by as much. But it was just enough that we weren’t enough better than our placebo arm.
We changed modality from the current standard (we were an injection rather than a tablet and all the trial participants were super excited.
- civilized 5y agoThere is no such thing as a standard placebo rate. If there was, there would be no need for every study to have a control group.
- skrebbel 5y agoSo maybe that isn't what the GP meant? You're telling the person who did a study that they misunderstand the utter basics of studies, based on a 3-sentence comment they wrote.
- rictic 5y agoSometimes people misunderstand the basics of their full time work yes We've all seen that person, and almost all of us have at times _been_ that person And unfortunately, given the replication crisis, there is no reason to assume that a published scientist is not making a fundamental error that undermines the validity of their work. It apparently happens quite frequently, and we should be quite grateful for those that question and probe at assumptions and potentially faulty analysis techniques
- deleted 5y ago[deleted]
- mauricioc 5y agoI understood it as "(standard placebo) rate", not "standard (placebo rate)". That is: "standard placebo" (tablets) << "new placebo format" (injection with no active components) < "real drug" (injection).
- deleted 5y ago[deleted]
- gumby 5y agoFor the particular indication we were going after there had been a number of topical trials and academic studies that showed that the placebo response was less than 1%, essentially no different from spontaneous (i.e. no treatment). Same was true of oral. This is pretty common in fungal infections unfortunately. The FDA wanted us to compare against the topical treatment placebo rate for various technical reasons. Perhaps you thought that “standard” was some sort of standard for any placebo for any indication and any mode of administration? Indeed that would make no sense. Even specifying a placebo itself is non obvious. Of course your procedure and the object itself (tablet, whatever) is ideally indistinguishable by the study participant and, ideally the clinician (hard to do, say, when it’s a surgical procedure; you can’t hide that from the clinician). But even with a pill, you can’t always just supply, say, a slug of mannitol — that might actually affect what you’re studying.
- civilized 5y agoThanks, this is helpful additional info. Sorry, I didn't mean to contradict you, I was actually trying to reinforce the principle behind your experience. There is no true "standard" for what sort of placebo should be used in a trial, even if something has become "standard" in the sense of commonly used. It is not something that can be specified in the abstract, but is a matter of expert judgment with many variables. Your trial gave an appropriate placebo, regardless of the "standard" in the field, and thus you were shielded from overstating the evidence of drug effectiveness.
- HWR_14 5y agoSo you just accidentally performed an experiment that injections have a stronger placebo effect than pills.
- dTal 5y agoFor that, they would have needed a control group that took placebo pills. They can estimate the likely behavior of such a group from other trials, but it's not a rigorous experiment unless they do it themselves, carefully controlling all the other possible variables.
- csee 5y agoAssuming methods were the same, the first study was the control.
- dTal 5y agoYou can't do that, I'm afraid. Too many uncontrolled variables still. What if placebo rates change seasonally? Also, you cannot properly double blind the test - the experimenters all know about the prior study, and know which cohort they are treating. To be fair, your attitude is quite common in cash-strapped university departments - but it leads to bad science.
- HWR_14 5y agoYou couldn't double blind that study, it would be obvious which treatment group people are in.
- tsol 5y agoThis is something we know to be true already. The more invasive, the more powerful the placebo effect. >Weirdly enough, surgery’s invasiveness may explain some of its potency. Studies have shown that invasive procedures produce a stronger placebo effect than non-invasive ones, said researcher Jonas Bloch Thorlund of the University of Southern Denmark. A pill can provoke a placebo effect, but an injection produces an even stronger one. Cutting into someone appears to be more powerful still. https://fivethirtyeight.com/features/surgery-is-one-hell-of-a-placebo/ https://fivethirtyeight.com/features/surgery-is-one-hell-of-...
- deleted 5y ago[deleted]