4 ms·
To borrow an analogy from cognitive science, deep learning has pretty much mastered System 1 thinking in independent domains (image, language, audio) and scalin
by blueblisters 4y ago
To borrow an analogy from cognitive science, deep learning has pretty much mastered System 1 thinking in independent domains (image, language, audio) and scaling laws suggest we have a clear path to self-supervised multi modal models (video+audio+text) by applying more data and compute. We will likely miss critical world knowledge about dynamics, contact forces, taste, feel etc. until we figure out a way to efficiently collect datasets for these modalities.
What’s less certain is the path to System 2 thinking that is required for true AGI. We have yet to find evidence that deep learning is enough for AI to learn planning and conscious thinking.