3 ms·
I agree, but AI models are growing in capability extremely fast. To put it in perspective when I was learning about neural networks in ~2009 it was still activ
by kypro 3y ago
I agree, but AI models are growing in capability extremely fast.
To put it in perspective when I was learning about neural networks in ~2009 it was still actively debated in the field whether neural networks were even the right paradigm for general intelligence. Back then one even knew how to make deep neural networks work well. They sucked so bad and had sucked for so many decades that most in the field just assumed that they probably weren't going anywhere without some significant advancements.
Then in the early 2010s the field exploded after a few minor algorithm tweaks allowed deep neural networks to really begin working. But even then they kinda sucked at a lot of tasks outside of niche applications like image recognition. But then a few years later we made a few more algorithmic improvements and suddenly we had pretty decent chatbots. And then a few years after than OpenAI created GTP-3.
What I'm saying is that basically went from most experts in the field doubting whether neural nets would even work to GPT-3 in about 10-12 years. That's absolutely insane progress.
With this rate of improvement the "foreseeable future" is probably less than a decade away. Assuming progress continues at this pace I strongly suspect we'll have LLMs able to beat the best humans in software development in 5 years.