4 ms·
> I'm not 100% sure, but I think in 2012 chatbots still used handcoded rules. So we switched from handcoded rules to trainable neural networks in just a few yea
by majormajor 5y ago
> I'm not 100% sure, but I think in 2012 chatbots still used handcoded rules. So we switched from handcoded rules to trainable neural networks in just a few years. Models like GPT-3 are interesting because they are conceptually simple, and are able to do (previously) complicated tasks without any explicit training (e.g. simply by processing lots of text and trying to predict the next word). This is a huge advancement in AI field, even if many more advancements are needed to get to the human level.
This seems like a very optimistic take on the timeline.
It took us 50 years to go from ELIZA to GPT-3. And it still is "dumb" compared to human intelligence.
So how long for the next major achievements? Are we talking years for each, or more decades?