4 ms·
It took us nearly 70 years to get to this architecture and the processing power to support it. If we are waiting for a new breakthrough architecture, it could
by daveguy 2y ago
It took us nearly 70 years to get to this architecture and the processing power to support it.
If we are waiting for a new breakthrough architecture, it could be decades. Our brains send signals with very high concurrency to individual processors (neurons). Each neuron is massively more complex than a single ReLU function and we have billions of them. If we need that kind of parallel processing and data transfer to match human thought and flexibility, it could be another 70 years before we see AGI.
That said, I do think LLMs are one of the biggest AI breakthroughs since the inception of AI. And I am sure that it, or something very similar will be part of an eventual AGI.