6 ms·
A review on protein language models
- deleted 2y ago[deleted]
- deleted 2y ago[deleted]
- pama 2y agoI’m happily impressed that non experts find this area intriguing. I hope more people start to work at the interface of biology, chemistry, and AI.
- mcswell 2y agoDan Gusfield wrote a book in 1997 entitled "Algorithms on strings, trees and sequences: Computer Science and Computational Biology". We (what was then the Center for Advanced Study of Language at the University of Maryland) found some of the techniques described there to be useful in (natural) language analysis, particularly morphology and for comparing words in related languages.
- Raztuf 2y agoThe intersection between biology and computer science is by far my favorite topic. I wish I would have gone into bioinformatics after my CS masters degree. Both sciences really get the best out of the other.
- theGnuMe 2y agoMost bioinformaticians are biologists.
- jhbadger 2y agoIt depends on what type (and also whether you distinguish computational biology from bioinformatics). The people who create new algorithms for sequence assembly, protein folding, etc. tend to be computer scientists who got into biology. On the other hand, the people who analyze biological data computationally tend to be biologists who got into computing.
- theGnuMe 2y agoThey are arguably computer scientists who do “bioinformatics” by building tools. Different skill set. Also not a large number of them. Most bioinformatics jobs need domain specific bio knowledge. Things will change even more as DNNs take over.
- BenFranklin100 2y agoI am gobsmacked by how little programmers know about the underpinnings of actual human language. This guy sounds like a SoCal 1960s burnout going on about being one with language of the forest.
- QuiDortDine 2y agoTo be fair there is a disclaimer about the limits of metaphor, plus the article is really about protein folding, not natural language. Still, I'm curious as to which "underpinnings of actual human language" you think he's misunderstanding or misrepresenting?
- alams 2y agoUnrelated to conversation. But Apoorva is a female name. So its probably she. :)
- BenFranklin100 2y ago[flagged]
- taiduoxiaoqi 2y agoActually while it's generally female, it's not always! It depends on the region of Indian continent / ethnic group, as the final "-a" in many Sanskrit-roots may or may not be dropped depending on the modern language of derivation. For example, I know several Telugu, Marathi, and Bengali males named Apoorva/Apurva. That being said, it does appear that this instance of Apoorva is indeed a female name (and in general, Tamil names like this one don't keep the aforementioned "-a" in the masculine).
- bawolff 2y ago> Unlike proteins, most human languages include uniform punctuation and stop words, with clearly separable structures. Latin has entered the chat.
- plank 2y ago(Submission title has a typo that article has not: languaUge models)
- the__alchemist 2y agoI'm excited to see where this, and Alphafold go. I'm also interested in a different direction for modeling proteins: ab-initio. I am curious if we can get a good-enough simulation of charge density around atoms to simulation folding using electric force models. It seems that chemists are using very computationally-intense models (HF, Kohn-Sham DFT etc) where the wave function (and therefore charge density) is modeled as a product etc. This does not scale well as electron count goes up. And, Valence Bond and Molecular Orbital theories of bonding both seem like not great approximations. I am suspicious we can come up with reasonable models of charge density for atoms and simple molecules without this complexity, by solving the Schrodinger equation; the relation between psi'', psi, V, and E. And then perhaps interpolating various solved solutions, incorporating ambient water molecules etc. I can, unfortunately, find very little about this approach, but am making progress on a program that will probably go no where, but I still feel is worth building. Incorporating spin is proving tricky. It is possible we need to model using spinors, but I am suspicious there may be shortcuts where we accept Fermi-Dirac statistics as an axiom, without using exchange terms. Of course, modelling the electron-electron interaction is tough because you need to integrate over 3D space, and there is a feedback loop between psi, charge, V, which then feeds back into psi for the other electrons, and vice versa! This is fringe, and probably intractable, but... seems worth trying. One of the key challenges is the big challenge with modelling in general: We have differential equations that can verify a solution, but not come up with the solution... This, at least, gives a validation for work on this topic. Even more fringe, but relevant: I wonder if the rules of quantum mechanics are intrinsically tied to nature's fondness of differential equations, and are key to how nature "solves" them.
- dekhn 2y agoIt's still unclear to me that using QM to simulate protein folding or enzymatic activity is a worthwhile endeavor. Even highly approximate QM methods don't seem significantly better than classical force fields for recapitulating folding dynamics, and the actual amount of computational effort required would be astronomical. I would recommend against it simply because we know of better, more economical methods, to get at solutions we need.
- 2y ago
- COGlory 2y agoI appreciated this article. These analogies always fall apart at some point (and the article points this out) because these are complex processes, but I appreciate these attempts to turn biology into a human problem, because at the very least, it'll have the effect of getting more people up the learning curve.
- benced 2y agoIt bums me out that the way to get rich via AI is to throw an OpenAI API key at a SaaS app, not solving fundamental hard science problems.
- wy35 2y agoHonestly I wish I learned more biology in college instead of cruising through a CS degree for a generic software engineering career. Now that I’ve gained more interest in bio, the doors have closed.