8 ms·
A watershed moment for protein structure prediction
- madengr 7y agoI had the protein folding project running in my computer for a few years. Can these deep learning models be distributed like that, or do they require tightly coupled processors? Seems the latter as there was a recent IEEE article on a wafer scale array of CPU for deep learning.
- LatteLazy 7y agoUnless I misunderstood (likely, I'm not smart), you still need to calculate the closeness field for a given protein. And that will be 1000s of points each calculated separately. Only once you have that do you give it to ML to find the thermodynamicly favourable value.
- mkagenius 7y agoAtleast those (obsolete?) bitcoin miners can be put to this use.
- cs702 7y agoFor background, read this fantastic blog post by the same author, Mohammed AlQuraishi at Harvard Medical School, from a year ago: https://moalquraishi.wordpress.com/2018/12/09/alphafold-casp13-what-just-happened/ https://moalquraishi.wordpress.com/2018/12/09/alphafold-casp...
- wpasc 7y agoThanks for posting, it was a great read. I especially enjoy the segments where he upfrontly addresses "an indictment of academic science" and "an indictment of pharma". He pulls no punches in saying how embarrassing it is for pharma and academia to be literally outclassed by DeepMind. A great quote: "If you think I’m being overly dramatic, consider this counterfactual scenario. Take a problem proximal to tech companies’ bottom line, e.g. image recognition or speech, and imagine that no tech company was investing research money into the problem. (IBM alone has been working on speech for decades.) Then imagine that a pharmaceutical company suddenly enters ImageNet and blows the competition out of the water, leaving the academics scratching their heads at what just happened and the tech companies almost unaware it even happened."
- dekhn 7y agonobody is embarassed here. pharma doesn't work on protein folding prediction. now they can take the published results and code and use it, but protein fold prediction has not, is not, and probably will not ever be the rate limiting step in novel drug discovery and development.
- travisporter 7y agoReally good read! They requested the author submit it as a journal letter. This quote stuck out to me: "Keep in mind that unlike other areas of machine learning, new protein structures are not appearing at an increasing rate, and so waiting things out will not help."
- deleted 7y ago[deleted]
- vkreso 7y agoLovely read
- suhaildawood 7y agoFor those unaware of cryo-EM (cryogenic electron microscopy), I highly recommend reading into it. A structural biology renaissance is upon us.
- nl 7y agoCode and neural network weights for AlphaFold: https://github.com/deepmind/deepmind-research/tree/master/alphafold_casp13 https://github.com/deepmind/deepmind-research/tree/master/al...
- synthmeat 7y agoIs there or will there be AlphaFold CASP14 entry too?
- choeger 7y agoI am not an ML engineer (except when I program in ML, of course ;)). But this sounds a lot like the following: 1. We had a model that worked in principle, but the search space was practically infeasible. 2. We made an observation that a different model might exist that makes the search space irrelevant. 3. We threw ML at it. 4. Now we might have a model that fulfills (2) but we cannot be sure because we used a black-box approach. 5. Somehow the results are exciting. Better results would be really exciting. 6. We hope that more data yields these better results. Is that correct? Am I the only one to lament these black-box approaches? Should there not be a bunch of people now studying the learned models to figure out if much better results can actually exist?
- mlthoughts2018 7y agoWhat do you mean by “black box” model? How do you know when a model “explains” something or not? How do you know if you are missing a key feature or degree of freedom in a model? Suppose you have two models, A and B, where A gives much poorer predictions than B. Is it possible for A to “explain” things better when it is not capable of producing adequate predictions? Since nature itself is not boiled down to logical elements like math proofs, what about the inherent ambiguity of language or mental models when assessing explainability? Did we really explain anything, or just decompose a problem into units of thought that artificially feel compelling for human minds at this moment of history? What would distinguish a “real explanation” from a convenient fiction, if not purely predictive capability?
- brmgb 7y agoBlack box model is a perfectly well understood term of art. It means a model which has a somewhat opaque internal working. A lot of modern ML approaches treat the model as a black box in that it is not particularly clear how the features actually interact to reach the prediction.
- mlthoughts2018 7y agoI work professionally in machine learning for over ten years now and I deeply dispute what you say, and many other practitioners do as well. > “not particularly clear how the features actually interact to reach the prediction.“ This is quite true of many models, such as linear regression in the wild. You may also have a clear but wrong picture of how features interact, eg looking at coefficients of interaction terms in a misspecified linear model. See for example, “The Mythos of Model Interpretability” - https://arxiv.org/abs/1606.03490 https://arxiv.org/abs/1606.03490 Without a coherent definition of what “not black box” or “explainable” means scientifically, the buzzword of “black box” is also meaningless and is more of a political game to be a gatekeeper over what models are allowed to be used than any kind of honest intellectual inquiry. I’ve worked professionally on systems where misspecified linear models and text models using simple ngram boosting were vastly more inscrutable than comparable neural networks or dimensionality reduction models for the same applications. Nobody has any scientifically cogent idea of what makes a model “explainable” other than arguing semantics.
- s_dev 7y agoWill this have any impact on the Folding@Home efforts?
- angrygoat 7y agoYes, I was wondering about this too. It's been going on for a very long time – I remember it was shipped with the PS3, I used to leave mine running sometimes to contribute to the effort.
- jcoffland 7y agoFolding@home is working on a different problem. Folding@home finds the path a protein takes to arrive at its final structure, not just the final structure. One of the main goals is to understand protein misfolding or where on the path things go astray to result in disease. After all these years, we are still at it. New methods are regularly evaluated and the simulation software is being refined all the time.
- RocketSyntax 7y ago"The resulting algorithm outperformed all entrants at the most recent blind assessment of methods used to predict protein structures, generating the best structure for 25 out of 43 proteins, compared with 3 out of 43 for the next-best method."
- KKKKkkkk1 7y agoThis is remarkable. Teams of researchers all over the world have taken part in the CASP competitions for decades. Many attempts using machine learning and ANNs have been made. What is it about DeepMind that allowed them to make such a breakthrough? Do they have expertise in deep learning that does not exist in academia? Incredible amounts of compute that academia cannot afford?
- ibarelyknowher 7y agoAlphabet owns way, way more computers than anyone else. You could lose any of the “top supercomputers” in the cracks of their datacenters.
- dekhn 7y agoThe techniques DM used are popular in academia right now, too. Using evolutionary data to shortcut hard problems has been key to advancement in protein research for decades. DM just executed better, a combination of smart people, some good ideas, and lots of experimentation. NEver underestimate the ability of company that exists to win games, to win competitions.
- natechols 7y agoAnd never underestimate the amount of money that a big tech company can throw at a random problem. DeepMind probably blew through the equivalent of multiple R01 grants writing that paper.
- robocat 7y agoBig biotech can throw big amounts too. And I read that the size of the team was 10 people - that's not a big number. The compute power applied was not why they had this outcome.
- deleted 7y ago[deleted]
- deleted 7y ago[deleted]
- DrScientist 7y agoAs the summary says, the basic approach ( evolutionary data -> position coupling -> to distance restraints - into structure solver ) is actually quite old, with the key paper back in 2011. In fact, the distance constraints to 3D structure part is in fact very old - I was calculating structures from experimentally determined distances 30 years ago. You need a surprisingly low number of fairly weak ( these atoms are between 3 and 5 Angstroms ) distances to determine a 3D structure if you have a decent number of long range ones. What they have done is execute better. However the problem they are working on sequence -> structure though it's been a long term 'holy grail', practically it's not that useful! The models typically aren't quite good enough, it's not predicting interactions, and experimental methods to determine structures have also moved on in leaps and bounds. As the article briefly mentions what you really want to do is go the other way. Designed novel structure -> protein sequence to make it. One way to do that if you have a function going the other way ( like alphafold ( let's ignore limitations for now - ie does a knowledge based approach work well for completely novel folds ? ) ), is some sort of heuristic search - however the search space is huge and a step size of hours isn't going to cut it.
- thaumasiotes 7y ago> However the problem they are working on > sequence -> structure I recall reading about a result a couple of years ago supposedly demonstrating that "synonymous" DNA codons were in fact not synonymous, because the ribosome took systematically different amounts of time to process them, and the difference in construction time resulted in different folding for the protein. This would imply that the problem "sequence -> structure" is not well defined, at least if the sequence in question is the sequence of peptides making up the protein and not the sequence of codons making up the gene that codes for the protein. Do you know anything about this? Am I just making it up?
- hobofan 7y agoThe phenomenon you described does exist[0], and similar effects (though rarely as severe) in cotranslational folding have been known for some time now. AFAIK it's not studied that intensely, as it's hard to study experimentally, and it is not expected to have a significant effect on final protein folding. During the folding process proteins often undergo partial misfolds, and defold again (the protein is basically doing a gradient descent search for the lowest energy state), so a small misfold at the beginning of the the translation process will rarely make it into the final fold. Apart from protein folding there are other interfering folding mechanisms like chaperone proteins that also make it hard to phrase it as a straight "sequence -> structure" prediction problem, though they often only exist for a small number of the total proteins (in humans). [0]: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5737824/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5737824/