3 ms·
I see two things currently happening in ML: 1. The era of ML benchmarks is ending. New models have to be and will be evaluated the same way human experts are e
by p1esk 4y ago
I see two things currently happening in ML:
1. The era of ML benchmarks is ending. New models have to be and will be evaluated the same way human experts are evaluated.
2. Foundational models are becoming multi modal. There will be no separation of text and image generation. Sure, different methods will be used for each, but the learned representations of visual and textual objects in models like Stable Diffusion already live in the same conceptual space.
I don’t think there will be specialized generative models for chemistry two years from now. There will be GPT-5 (and similar competitors) which will be used to perform all kinds of research, including chemistry.
- sdenton4 4y agoI think this is a bit over confident, though... For example, AlphaFold just fundamentally isn't a language model, but is fundamentally useful. We'll still need these models that Do Stuff in many areas, and that will still involve benchmarks... Even if we're able to ask GPT-N+1 to design the next version of the model for us.