2 ms·
I agree that today's AI hallucinates, and will keep doing so no matter how much it's scaled with parameter count and FLOPs. But there's also a ton of effort an
by mitthrowaway2 2y ago
I agree that today's AI hallucinates, and will keep doing so no matter how much it's scaled with parameter count and FLOPs.
But there's also a ton of effort and an army of PhDs being bent to the purpose of fixing this, and not via mere scaling but also by mixing with other techniques. If the money doesn't dry up then I think they'll have cracked the hallucination problem within ten years easily. Certainly it won't take 1000.