4 ms·
These achievements are impressive, but I'd rather not overhype it. * GPT-4 still hallucinates as hell, can't do math, fails as basic logic, can't handle really
by Athari 3y ago
These achievements are impressive, but I'd rather not overhype it.
* GPT-4 still hallucinates as hell, can't do math, fails as basic logic, can't handle really big contexts, hard to update, easy to jailbreak etc.
* AlphaGo was defeated by a Go amateur with a help of another AI.
* AlphaStar basically failed to achieve real goals, was trivial to cheese even after defeating high-ranked players sometimes.
All these problems are architectural, you can't just throw more money and GPUs at it like GPT-2-3-4.
It's hard to predict at this point. We may get to AGI anywhere from 5 years to 100 years.