7 ms·
AlphaFold’s new rival? Meta AI predicts shape of 600M proteins
- Simon_O_Rourke 4y agoMore in their line to go and predict the effects of their Metaverse strategic decision making on the share price!
- robertlagrant 4y ago> The predictions are freely available for anyone to use, as is the code underlying the model, says Rives. Smart. If you might get cut, having all your work available to pick up from is a great idea.
- pelorat 4y agoAnd how does it stack up to RoseTTAFold? Isn't RoseTTAFold much faster than AlphaFold but slightly worse in accuracy?
- ta988 4y agoSo? Use meta ai structures first that you refine in alphafold. Best of two worlds.
- kgc 4y agoWhy does a language based model work for what is essentially physics?
- civilized 4y agoWhy does language describe the physical world at all?
- est 4y agoIIRC they don't really "understands" physics. They just recall known folding structures really, really well. They can't discover new protein structures yet to be verified by Cryo-EM.
- theGnuMe 4y agoNature reuses amino acid patterns.. so the structure is embedded/encoded in the sequence.
- davidatbu 4y agoI'm fairly certain that the model was not at all trained on language data. It's just that the "neural architecture" (specifically, the Transformer architecture) was first discovered in the NLP realm. If your question is why does an architecture designed for NLP work well for aminoacid sequences, it turns out that the Transformer architecture is surprisingly versatile. It works amazingly well for other sequence-like data (like audio), and even for images (which, to me, is surprising, since images are not a one dimensional sequence like text or audio). The Transformer architecture (Particularly, the Multihead self-attention[0] mechanism within the Transformer) is, in my estimation, once of the key innovations in deep learning in the past 5 years. It's used in pretty much everything in deep learning (GPT-3, AlphaFold, DALLE-2/Stable Diffusion, OpenAI's Whisper, come to mind). [0] https://lilianweng.github.io/posts/2018-06-24-attention/#multi-head-self-attention https://lilianweng.github.io/posts/2018-06-24-attention/#mul...
- xnx 4y agoLet me know when Meta wins a Nobel Prize.
- tromp 4y agoTrading accuracy for speed using language based models: > Meta’s network, called ESMFold, isn’t quite as accurate as AlphaFold, Rives’ team reported earlier this summer2, but it is about 60 times faster at predicting structures, he says. “What this means is that we can scale structure prediction to much larger databases.” > Burkhard Rost, a computational biologist at the Technical University of Munich in Germany, is impressed with the combination of speed and accuracy of Meta’s model. But he questions whether it really offers an advantage over AlphaFold’s precision, when it comes to predicting proteins from metagenomic databases. Language model-based prediction methods — including one developed by his team3 — are better suited to quickly determine how mutations alter protein structure, which is not possible with AlphaFold. “We will see structure prediction become leaner, simpler cheaper and that will open the door for new things,” he says.
- dekhn 4y agoStructure prediction is embarassingly parallel, and rarely requires any specific protein to be predicted- which can be done at any time, including precomputed- in an extremely short period of time. DeepMind has no trouble getting the inference time at Google to compute predictions using their model for any protein of interest or the largest database. Thus, a faster but more inaccurate system is not really desirable unless it really does provide another feature, such as (as Rost says) predictions on mutations alter structure. But if alphafold works, then it would indeed be capable of predicting how mutations alter structure.
- aliqot 4y agoMeta has become a creepy metaphor for facebook: briefly the new cool kid on the block, but now awkwardly shows up at high school parties with their letter jacket on, talking about the time they almost made it to State.
- i_like_apis 4y agoYou are way off. Meta is easily among the top few AI research institutions in the world.
- belval 4y agoThat's a harsh take. FAIR (the Facebook AI research group) is a respected group in the field and they put out high quality research on a variety of topics. This would be like condemning research for AT&T/Bell Labs because the company was (even at the time) a terrible monopolistic corporation.
- tradecraft 4y agoThis meta metaphor on Meta is itself a creepy metaphor
- zip1234 4y agoSeems like this is a meaningful contribution to society. As are things like React and Pytorch.
- JackFr 4y agoWell, PyTorch.
- _Algernon_ 4y agoReact gives me 'nam flashbacks and I haven't even worked with a proper code base yet.
- aliljet 4y agoThis is incredible work, honestly. Is the theory here that humans seem to enjoy an intuitive understanding of protein folding? I seem to remember an online game (maybe https://en.wikipedia.org/wiki/Foldit https://en.wikipedia.org/wiki/Foldit) that exploited this intuition by crowdsourcing human suggestions for brute-force style protein folding work. And am I right that the goal is to create a best-effort short-cut to the final stage of brute-force final folding to get a real result?
- danielmarkbruce 4y agoIt's just about making simplifications where possible. You don't need a molecular dynamics simulation to predict where a pool ball will go. That simplification is easy to see and understand. Scientists and engineers have been making useful simplifications for a long time. There are other simplifications where a bunch of forces and masses can be cancelled out, or aggregated - but we can't see them. Can a computer see them with enough processing? It seems like it.
- AndrewKemendo 4y agoCan anyone describe how/where this actually fits into Meta's businesses? "As a test case, they decided to wield their model on a database of bulk-sequenced ‘metagenomic’ DNA from environmental sources including soil, seawater, the human gut, skin and other microbial habitats." Meta has a lot of data, but I'm unaware of them having a presence in the environmental/medical diagnostics industry which is where I assume this would be applied Perhaps they are going for a Bell Labs kind of structure?
- bawolff 4y agoIt gives them cred, cred in turn makes it easier to hire smart people in this field which has overlap with things that are actually meta's business.
- alecfreudenberg 4y agoHow could they not
- justapassenger 4y agoMeta has been one of the powerhouses of AI research for many years now. Why? Recruiting most likely.
- AndrewKemendo 4y agoYes, however all of that research was directly applicable to the Meta family of companies products - most specifically around NLP, image processing and computer vision with some work in RL. So it was applicable to the company, in addition to being good for recruiting. Unclear what products this would apply to
- the__alchemist 4y agoAs an outsider to both biology and AI, I feel like there's a more key problem than structure estimation from pattern-matching (over-fitting?) known data: Learning how the molecular dynamics work. I'm fascinated with how the folding might happen. The intermediate steps; how the backbone and sidechains react to change in temperatures; how much motion is going on in the sidechains in response to constant interaction with water molecules etc. How well does a classical rigidity/elasticity etc model apply to covalently-bonded molecules. How much flexing do various parts of the protein to real-time. How to make a model that ab-initio folds (or unfolds) without being tuned to experimental data. How much of the quantum interactions can we dodge due to working at the atomic scale vice electron-scale. How accurately can we model using dipoles, hydrophobic interactions, simplified hydrogen bond models etc. How much of the picture are we missing by only looking at the static aspect of the folded protein - ie experimentally or AI-determined static atom coordinates as the model.
- siver_john 4y agoAs an insider to both fields (and specifically their juncture to molecular dynamics). What you are discussing is of course being studied but the problem is that it is a lot more computationally expensive. We do have simulations of simple (read very small) proteins folding and unfolding but for larger ones the computational time to watch them fold can be gigantic, if not impossible due to the fact that proteins often fold as they are being made. Which means including a much larger process into a folding one which just further stresses computational resources. This computational problem is so enormous that a company at the cutting edge of research D.E. Shaw built a specialized computer solely for simulating proteins. Also most of the software used for this until recently had abandoned multi-GPU paralellism because it didn't scale well. The pandemic caused the need to simulate the virus on the entirety of Summit and introduced some work back into that route but it is still specialized (and wouldn't help for systems below a certain size anyways). Also my previous points have been for atomic models (e.g. we treat everything more like newtonian particles and ignore quantum effects) some things definitely need more resolution and at that level you are lucky to see protein fluctuations let alone folding.
- 4y ago
- uri4 4y ago[flagged]
- lucasmullens 4y agoThere were trials, and there aren't 10 billion people.
- uri4 4y agoThat is for next pandemic in 2023, silly :) And of course, there are always trials¡¿¶
- photochemsyn 4y agoCool stuff, but more likely useful as a primary filter or search tool rather than for detailed understanding of protein structure and function. See this quote: > "Sergey Ovchinnikov, an evolutionary biologist at Harvard University in Cambridge, Massachusetts, wonders about the hundreds of millions of predictions that ESMFold made with low-confidence. Some might lack a defined structure, at least in isolation, whereas others might be non-coding DNA mistaken as a protein-coding material." Understanding of how these proteins function requires high-resolution information about bond angles and atom-atom distances, particularly for non-structural proteins (i.e. interesting catalytic enzymes). Hence, wet-lab work and protein structure characterization via X-ray and NMR methods aren't going anywhere.
- COGlory 4y agoMedium confidence is often close enough that you can formulate a hypothesis, but high confidence still isn't close enough that you'd stake millions of dollars of experiments on it anyways. Most of the people in structural biology in pharma that I have chatted with said they're still solving the structures of their targets even with high-confidence AlphaFold models. For me, as someone solving structures on a monthly basis, AlphaFold is great because after I get back my electron density map, I dump my sequence into AlphaFold, get a model (of any confidence) and most of it fits well enough into my density map that I don't have to start trying to model from nothing, and it saves me honestly days of work.
- siver_john 4y agoThat's a cool way I had never thought about it being used. Just for my own curiosity do you know if that is a common use case in the protein solving field? (I'd imagine it would also be useful in NMR experiments for getting initial point labels).
- flobosg 4y agoIt is quite common to use predicted models as an aid for phasing and molecular replacement; even Foldit models have been adopted for that purpose: https://www.nature.com/articles/nsmb.2119 https://www.nature.com/articles/nsmb.2119