6 ms·
Look, I'm actually a massive optimist on this topic and think we can get very far with large language models. Memory I think will actually not be that difficult
by whimsicalism 5y ago
Look, I'm actually a massive optimist on this topic and think we can get very far with large language models. Memory I think will actually not be that difficult to solve, optimizing for long series of actions will be a hard one though, as will making an AI that can reason in a representationally invariant and transferrable way (ie. something that can reason just as well about data in the form of images as text).
I'm not saying we're not seeing continuous improvements on performance on benchmarks from scaling up - we absolutely are. But "the end of the benchmarks" is not AGI - even if we have a tool AI/oracle AI that can perform at a superhuman level on benchmark tasks (which I think is absolutely doable within the current paradigm), we do not have a general AI.
- FeepingCreature 5y agoHooking up transformers into an agent AI does not seem like a daunting task given the ability to generate snippets of reasoning on demand.