> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. I'd say its more tha

> Eliezer himself didn’t believe that staggering advances in AI were going to happen the way they did, by pure scaling of neural networks. I'd say its more than just scaling, only the smallest forms run on a modern phone, slowly, with caveats. Its far beyond anything reasonable. I still find it weird that there are probably multiple datacenters worth of compute just generating text.