3 ms·
The model is not based on DALL-E, rather it is a simple masked auto-encoder trained unsupervised with tons of protein data. On top there is another transformer
by visarga 4y ago
The model is not based on DALL-E, rather it is a simple masked auto-encoder trained unsupervised with tons of protein data. On top there is another transformer trained with supervised 3D data to generate the spatial representation.
- ramraj07 4y agoDavid Bakers lab is using diffusion methods to design new proteins: https://youtu.be/oO-uR_3fL1g https://youtu.be/oO-uR_3fL1g (skip to the diffusion models section but I recommend anyone with biology or AI interest to watch it fully). Also dudes 58. Wow.
- dzdt 4y agoThe comment "Also dudes 58. Wow!" comes across as repulsive ageism. Probably better to delete that.
- bsaul 4y agoMaybe it’s only referring to the fact that the person in the video looks much much younger ?
- ramraj07 4y agoAs the other commenter said, I’m just extremely impressed at how young he looks for his age. Not even sure if you thought I was ageist because he’s too old or too young lol. 58 seems about right for someone who’s achieved as much as he has (perhaps even young).
- fnordpiglet 4y agoTrue, but I read it as “wow even oldsters can use computers” - I think given the social ills in tech adding a modifier like “he looks young for being 58!” would help clarify confusion, both are valid readings depending how cynically you are feeling at the moment. Anyway you’re right he’s super young looking. Must be eating a lot of synthetic AI protein.
- ranger_danger 4y agoI have never met anyone in my entire life who would think for one second that anything in OP's statement was either "repulsive" or "ageism". Where do people get this new-age rhetoric from anyway? Does anyone actually believe it or are you just virtue signaling?
- dekhn 4y agoDavid has looked preternaturally young for as long as I've known him (25 years now!)
- dekhn 4y agoWhich if you think about it, is awesome- a simple autoencoder and a transformer with tons of data. It's sort of the dream of ML since it combines automatic learning of a representation with a statistical sequence model using two methods which have been successful in a number of other fields, aren't that complicated for regular scientists to understand, and isn't that far from how people were modelling proteins before the ML revolution.