3 ms·
Also these industry leaders believe that we can get there just optimising llms: this is a mistake for sure: the only general intelligence we know is human and h
by anonzzzies 1y ago
Also these industry leaders believe that we can get there just optimising llms: this is a mistake for sure: the only general intelligence we know is human and humans add new facts to their neural nets daily while llms need weeks of expensive training and then have a knowledge cut off. It cannot happen like that.
- stingraycharles 1y agoYup, it’s as if you fine-tune your model constantly, every interaction triggering backpropagation. Current techniques absolutely are not economically viable to do that, but I can imagine that maybe OpenAI are running some small scale experiments like that. You’d basically need a dedicated model per user (or chat even) + continuous training infrastructure as a prerequisite for AGI, I don’t see that happening in the next decade or without a completely different paradigm, let alone being economically viable.