3 ms·
It talks about how you can go from a language model that simply generates text to an agent that is capable of performing actions in the real world Essentially,
by msamogh1 6y ago
It talks about how you can go from a language model that simply generates text to an agent that is capable of performing actions in the real world
Essentially, the missing pieces in the picture come down to input and output modules. "How do you formulate any given problem into a form that a language model can answer?".
- leogao 6y agoI don't doubt the input and output modules will need some work, but in the grand scheme of things probably not that much. The big missing piece imo is just models with better world models—and it doesn't look like the scaling wars will stop anytime soon, nor does it look like size will stop helping, at least not anytime soon. (https://www.gwern.net/newsletter/2020/05#baking-the-cake https://www.gwern.net/newsletter/2020/05#baking-the-cake)