4 ms·
Show HN: We trained a bidirectional masked generative model on protein sequence, structure and function. ESM3 work over tokenized representations of multiple m
by ebetica0 2y ago
Show HN:
We trained a bidirectional masked generative model on protein sequence, structure and function. ESM3 work over tokenized representations of multiple modalities and can generate proteins with high fidelity and controllability. ESM3 further improves with feedback using alignment methods similar to Reinforcement Learning from Human Feedback (RLHF) applied in LLMs.
We have prompted ESM3 to generate fluorescent proteins with a chain of thought. Among the generations that we synthe- sized, we found a bright fluorescent protein at far distance (58% identity) from known fluorescent proteins. Similarly distant natural fluorescent proteins are separated by over five hundred million years of evolution.
- Check out our github repository: https://github.com/evolutionaryscale/esm https://github.com/evolutionaryscale/esm
- Read the paper: https://www.evolutionaryscale.ai/papers/esm3-simulating-500-million-years-of-evolution-with-a-language-model https://www.evolutionaryscale.ai/papers/esm3-simulating-500-...
- And make your own proteins on Colab: https://colab.research.google.com/github/evolutionaryscale/esm/blob/main/examples/generate.ipynb https://colab.research.google.com/github/evolutionaryscale/e...