4 ms·
> Why couldn't deep neural nets scale to AGI Speaking as a former cognitive neuroscientist, our current NN models are large, but simpler in design relative to
by KingMob 3y ago
> Why couldn't deep neural nets scale to AGI
Speaking as a former cognitive neuroscientist, our current NN models are large, but simpler in design relative to biological brains. I personally suspect that matters, and that AI researchers will need more heterogeneous designs to make that qualitative leap.
- ryanklee 3y agoSeems like that's happening with mixture of experts already. Not sure you are presenting an inherent LLM barrier.
- Vecr 3y agoHinton's done work on neural nets that are more similar to human brains and no far it's been a waste of compute. Multiplying matrices is more efficient than a physics simulation that stalls out all the pipelines.
- KingMob 3y agoDoing the wrong thing more efficiently doesn't make it into the right thing.