3 ms·
No they haven't. The hallucinate exactly as much as they did five years ago.
by otabdeveloper4 1y ago
No they haven't.
The hallucinate exactly as much as they did five years ago.
- atleastoptimal 1y agoAbsolutely untrue. Claiming GPT-3 hallucinates as much as o3 over the same token horizon on the same prompts is a silly notion and easily disproven by the dozens of benchmarks. You can code a complete web-app with models now, something far beyond the means of models so long ago.
- otabdeveloper4 1y ago> caveats and weasel words > "benchmarks" Stop drinking the coolaid and making excuses for LLM limitations, and learn to use the tools properly given their limits instead.
- antihero 1y agoThey really don’t though.
- otabdeveloper4 1y agoLarger context lengths are awesome, but they don't fundamentally change the failure modes of LLMs.