3 ms·
Right. And the industry has slowly realized this. The "AGI" hype has died down since reaching a fever pitch when GPT-4 was released. Result after result has sho
by skepticATX 3y ago
Right. And the industry has slowly realized this. The "AGI" hype has died down since reaching a fever pitch when GPT-4 was released. Result after result has shown that LLMs have extreme difficulty generalizing beyond what they've been trained on. Which really isn't much of a surprise, if you think about how deep learning works.
Of course, the major labs and AI influencers are still publicly shouting from the rooftops, because that is what sells. But it's getting harder to deny the obvious.
Ultimately, the problem is that there is really no consequence for being wrong, but tremendous upside for this kind of magical thinking. Someone should start tracking predictions so we can ignore those who continually get things wrong.