5 ms·
It really remains to be seen whether these approaches will make any difference in efficacy or cost of pharmaceuticals. Blindly thinking that having better simu
by dekhn 8y ago
It really remains to be seen whether these approaches will make any difference in efficacy or cost of pharmaceuticals.
Blindly thinking that having better simulations of proteins and drugs is going to solve any of the hard problems has led to a great deal of waste.
- jimbofisher1 8y agoI'm not going to cry for Shaw if he wastes his money. He has mountains of it...
- melling 8y agoI’m not sure why you consider it a great deal of waste. Building better models that simulate a human biological process must have some sort of payoff? It increases human knowledge, and should provide a foundation on which others can build.
- cowsandmilk 8y ago> Building better models that simulate a human biological process must have some sort of payoff? It increases human knowledge, and should provide a foundation on which others can build. That really is still not clear for the models described in the article. In reality, these models are rehashes of what Murcko was having people do 25 years ago. Big articles were written about Vertex applying Free Energy Perturbation with pictures of Murcko accompanied by David Pearlman and Govinda Bhisetti. A book was written about these efforts, The Billion-Dollar Molecule, and more recently a sequel which partially describes how Vertex's efforts using these methods failed (The Antidote). Obviously, computational power has improved by orders of magnitude since 1989. So have our parameters for modeling proteins and small molecules. But it really is still not clear that MD or FEP really provide any useful insights into proteins that cannot be obtained more simply via NMR-based screens and linear regression. In fact, I recently saw a talk by Relay's VP of Computation where he described using Free Wilson Analysis at Relay[1] for their drug discovery, which is a linear regression method from 1964... [1] https://github.com/PatWalters/Free-Wilson https://github.com/PatWalters/Free-Wilson
- tyu100 8y agoGreat context. You don't have to go too far back in the archives of this site to find discussion on Andy Grove's similar big project to use in silico to destroy traditional pharma discovery. We haven't heard much from that project since.
- jjoonathan 8y agoA waste for society? No. A waste for the people doing it who are never going to be appropriately compensated for the value of their failure to society? Yes. The churn that arises as a consequence of the fact that we don't know how to reward failure (or even merely punish it less) is the real waste.
- cowsandmilk 8y ago???? I assure you, Mark Murcko (and others at Relay) are paid competitively to similar people in pharma.
- jjoonathan 8y ago> Mark Murcko He's on the admin / capital side of the equation and will do fine, I'm sure. > paid competitively That's not an endorsement and hardly an excuse. Unless things have changed dramatically in the last year or two, pay for computational / structural biologists is 1/2 to 1/3 of what a person with the same skills gets for helping build Uber for Poodles, which is in turn 1/2 to 1/3 of what a person with the same skills gets at AppleGooFaceZon or on Wall St. The field, like many scientific fields, runs on passion, naivete, and green cards, and is quite abusive to the people doing the actual work, even though it showers adjacent concerns with money. If science didn't suffer from such a severe value capture problem, scientists could win a seat at the table, but it does, so practicing scientists get shut out and the money goes instead to capital/risk, showmen (often "graduated" scientists themselves), lawyers, etc.
- vthallam 8y ago> A waste for the people doing it who are never going to be appropriately compensated for the value of their failure to society? Yes. Judging by their profiles, I don't think they care if they end up being a failure with this Venture.
- jjoonathan 8y agoYes, but if the scientific value capture problem were solved then science could scale appropriately rather than beg for charity. I was (and would be) much more valuable to society as a structural biologist than I am as a software engineer, but the market disagrees so vehemently that it's cost prohibitive for me to fight it, and the result is that we all lose. The reason why it disagrees is not hard to understand and not particularly difficult to categorize as a market failure rather than a "hard truth." I can't really think of a good way to actually address the problem, though, so mostly this just amounts to venting.
- dekhn 8y agoI didn't say that building better models didn't have a payoff. I'm saying this particular approach shows little to no evidence that it's truly revolutionary or even a marginal/incremental improvement over random guesses.
- scottlocklin 8y agoI am highly supportive of DE Shaw's efforts to make the world better. On the other hand, OP has a point: many of these sorts of things actually do not have a payoff. I knew some guys working on protein folding in the 90s. No payoff. One of 'em must be close to retiring by now. Shaw offered me a job to do an innovative kind of FTIR back when I graduated in 2004. Pretty sure that didn't pay off either. For that matter Shaw's original research was into the 'transputer' which also didn't pay off. The man's a risk taker, and perfectly entitled to spend his post tax income on whatever he likes. But a lot of science and stuff is dead ends, and, of course, avoiding known dead ends. Might very well be a dead end. He's been dumping considerable resources into this project since 2001; that's rather a long time ago now.
- davidkuhta 8y agoThe breadth of your second statement gives me pause, but as I'm not well versed in computational biology, I'll just ask: What are the hard problems?
- dekhn 8y agoThe single hard problem in pharma is predicting which drugs will get through to full approval, and how much it will cost from initial results. If you could do that reliably, it would completely transform pharma.
- vapemaster 8y agoThat's like saying the single hardest problem in AI is having a beyond human intelligent general AI. Sorry not trying to be pedantic but predicting what xenobiotics (ie foreign molecules) will do in the human body, much less a diverse sample of them is a really really really hard problem. One that will only be approximated and poorly at that. I'm sure there will continue to be approaches to reduce risk but clinical trials only exist because they have to. The only way we can evaluate safety and efficacy is empirically. Predicting things like hERG toxicity is somewhat doable. And I think the realistic bright future of AI in medicine will include better on target tox prediction and some off target effects. But it's hard enough to design the drug to bind the target, imagine predicting it's affinity for all other proteins and their isoforms in the population...
- reasonattlm 8y agoMost of the cost is regulatory. But there is a meaningful difference between a world in which it costs $1M to screen and a world in which it costs $100k to screen. In the latter world, startups become viable with intent to find a drug candidate, rather than only being viable if they already have one. That's a big important difference, and one that was only otherwise going to be solved by everyone transitioning from small molecule to gene therapy development.
- vapemaster 8y agointeresting point. though this ignores the (surprisingly) successful re-purposing strategies to reduce future regulatory burden and and reduce or even eliminate high throughput screening campaigns. that well will dry up sooner or later but other discovery platforms ie phage display etc. have become commoditized and robust enough that they are pretty accessible to even low capitalized startups if finding a ligand is what you need to get off the ground.
- HarryHirsch 8y agoThe real cost occurs in Phase 2 clinical trials, where 70 % of promising-looking compounds turn out to be no better than placebo. The body is a complex system with a huge number of enzymes and feedback circuits, this outcome isn't much of a surprise then. You can't blame the FDA. But thanks to Trump's "right-to-try" phase 2 will be a smaller hurdle now. Good luck, let's see how costs develop.
- randcraw 8y agoNo. Phase 3 is where all the cost of clinical trials comes from, not phase 2. P2 usually involves fewer than 100 patients and lasts for only a few months; P3 often runs to thousands of patients and can last for years, and then can be followed by supplementary P3 and even P4 trials, multiplying costs further. Phase 2 rises to a high fraction of clinical trial cost only in diseases with a very high mortality rate, like cancer. Then the drug may undergo a variant of P2/P3 trial where the general patient populace serves as early P3 trial participants, thereby reducing P3 trial cost normally paid entirely by the drug manufacturer. But even then, such a phase 3 trial will greatly outcost any phase 2, and will much more definitively answer the questions of drug safety and efficacy. The rules of those kinds of clinical trials (mostly cancer) where the "right-to-try" law is applicable thus will depart considerably from standard drug safety standards for almost all other kinds of drugs. That's because safety concerns are strongly deemphasized when investigating new cancer treatments due to 1) the high toxicity of alternative cancer therapies (usu. chemo), 2) the low survival rate and lifetime typical of most cancers, and 3) the lack of better alternative treatments. The lower standard for efficacy (and lower statistical power) inherent in phase 2 trials will certainly play a greater role in "right-to-try" than is usual for typical drugs. But this does NOT imply that taking the greater risks that will arise with these more speculative unproven therapies (like the Laetrile dud cancer therapy ca. 1975) are likely to return greater rewards. In all likelihood, by the time "right-to-try" comes into play for a patient, all hope will have been lost medically. Thus the fraction of cases where a patient will actually benefit from such a "hail Mary" therapy that's been facilitated via this law is essentially zero. Nor is the lack of methodical treatment regimen endemic to these still half-assed therapies likely to teach us much in the process of calling upon them just one second before midnight. No, "right-to-try" seems mostly an invitation for charlatans to charge megabucks for nutty therapies that have shown no level of success. If they had, "right-to-try" wouldn't have been needed. The era of hoping for a magic elixir is over, except in Hollywood and Trump's Washington, that is.
- yawrp 8y agoFor one, there are more candidates than capacity to run clinical trials. Costs & timelines for those have been going up over time. Lots of high-potential compounds just sitting on the shelf.
- HarryHirsch 8y agoA great deal of waste? 25 years ago we thought that genomics would boost drug discovery and development. It didn't pan out quite like that but thanks to the Human Genome Project costs for sequencing have dropped to almost nothing, and we have learned a great deal about protein evolution. Talk about waste!
- dekhn 8y agoI wouldn't really say the HGP taught us a lot about protein evolution. The original few genomes were snapshots of indivduals or amalgams. We do know a bit more about evolution from sequencing many more people (post-HGP), but it hasn't really been super-productive compared to previous work (note, my postdoc work was on protein functional evolution) from before the HGP. For example, Carl Woese, using only 16s RNA from a wide range of species and mostly hand-computed similarity clustering, managed to find a previously unrecognized kingdom. I don't think we've really had any truly revolutionary discoveries like that from HGP and post-HGP sequencing that focuses on humans.
- andbberger 8y agoThis comes across as exceptionally naive. Protein-engineering is a fundamental technology, and we've been constrained computationally for decades. Few things would have as far-reaching an impact on society as being able to accurately predict protein structure would.
- cing 8y agoRelay is not doing protein engineering or working on predicting protein structure. They are making models of protein dynamics to assist in drug discovery (often using already determined structures). We both disagree with the parent commenter that it's a waste, and to claim that Murcko and D.E. Shaw are going in "blindly" would be ignoring decades of research on protein dynamics of some of the hardest drug targets out there. The fact remains that there aren't many success stories of using simulations of protein dynamics to accelerate drug discovery. Computational chemistry protocols used routinely in pharma drug discovery typically do not include this type of detail.
- andbberger 8y agoI know, just an example. I wouldn't bet against relay right now - historical precendent is irrelevant here. There's an enormous opportunity for application of ML techniques in protein engineering (as an umbrella term...) - I've really been itching to take a crack at it but it's a moonshot... A well-positioned player with the right people could make a killing in this market right now.
- dekhn 8y agoCan you describe just how they would make a killing? I mean, in terms of making a product that sold, and produced drugs of value.
- andbberger 8y agoSure. My rates for consulting start at $500/hr...
- 8y ago