4 ms·
> we are still seeing exponential progress I dispute this. What appears to be exponential progress is IMO just a step function that made some jumps as the tran
by mrtranscendence 3y ago
> we are still seeing exponential progress
I dispute this. What appears to be exponential progress is IMO just a step function that made some jumps as the transformer architecture was employed on larger problems. I am unaware of research that moves beyond this in a way that would plausibly lead to super-intelligence. At the very least I foresee issues with ever-increasing computational requirements that outpace improvements in hardware.
We’ll see similar jumps when other domains begin employing specialized AI models, but it’s not clear to me that these improvements will continue increasing exponentially.