3 ms·
So, unsurprisngly, it appears that applying a transformer to multiple sequence alignments extracts somewhat more spatial information about proteins than we had
by dekhn 5y ago
So, unsurprisngly, it appears that applying a transformer to multiple sequence alignments extracts somewhat more spatial information about proteins than we had been able to previously squeeze out.
It's pretty clear at this point that the work led to a large improvement in psp scores, but there's literally nothing else groundbreaking about it; I don't mean that in a bad way, except to criticize all the breathless press about applications and pharma.
- mda 5y agoWell it did gave geoundbreking results, it is weird to see people dismisses it as "Not groundbrraking enough".
- dekhn 5y agoit was a nice improvement. that's fine. But it's ultimately just statistical modelling based on deep evolutionary information. It only works on homology modelling, it doesn't actually solve the larger protein structure prediction problem. Therefore it's not groundbreaking but a significant improvement.
- IshKebab 5y agoIt's perfectly reasonable to describe a very large improvement as groundbreaking.
- couteiral 5y agoI respectfully disagree. AlphaFold 2 demonstrated almost perfect performance for a multitude of proteins for which no meaningful templates were available -- hence, it was not doing homology modelling as it is generally understood, but ab initio protein structure prediction. What I would support is that AlphaFold 2 does not solve the protein folding problem: how, as opposed to what to, a protein folds.
- dekhn 5y agohow could they do ab initio? They depend on multiple sequence alignments. If I'm mistaken about this then I'll happily take back what I said, but there's no way that AF2 could work wihtout MSAs, therefore, it is not ab initio. Ah, OK checked the paper again. They're working on the "template" category which means there is structure-sequence information... maybe CASP organizers consider this ab initio ? The paper never mentions anything about ab initio predicitons. Is that what you're saying, that template methods are ab initio?
- couteiral 5y agoJust in case there is a confusion: there is a difference between available sequences (~300 million in standard protein sequence repositories) and structures (~170k structures in the PDB, perhaps about ~120k that are structurally non-redundant). A large amount of CASP14 targets have no available templates; in fact, many of them represented previously unseen topologies. However, all of them had some (in most cases, many) available sequences. The commonly accepted definition of homology modelling implies using a known structure ("template") as a scaffold to model the protein's topology. Since there are many CASP14 targets without appropriate templates, AlphaFold 2 simply cannot "just do homology modelling". I do take the point that the correct term is "free modelling" (it does not have, or does not use, any good structure as a template), and not "ab initio modelling" (it uses physics to fold the protein), though. A deep enough MSA is generally a requirement.
- dekhn 5y agoAgain, it's entirely possible I missed some very subtle point in AF2's system, but my understanding is that each target AF2 predicted had an underlying structural template covering the majority of the domain and the mapping was established through the MSA. IE, any MSAs would always include alignments to known protein structures. Are you saying their MSAs don't include alignments to known protein structures? (the reason I'm asking all this is because if I'm mistaken, then AF2 did do something "interesting", but everything in the paper says that everything they did is template based. If they are just folding proteins using MSAs without alignments to protein structures, that's far more interesting. I don't think they did that. edit: I've now reread the paper again, and I believe their claim of making predictions where there is no structural homology is incorrect from a technical perspective. I've communicated this to both the CASP organizers (whom I know) and DeepMind.
- visarga 5y agoIt seems amazing to me what the transformer can learn to SOTA levels, not just language but also images, video, code, math and proteins. Replacing so much handmade neural architecture with just one thing that does it all, that was an amazing step forward.
- sheggle 5y agoJust for my reference, what percentage of known but unfolded proteins (a wild guess is good enough), would you consider to be ab initio? How many don't have parts in any database?
- deleted 5y ago[deleted]