3 ms·
It's actually hallucinating more. The more they mess with these now mature models, models which no longer scale with training corpus size, the more they push a
by asadotzler 1y ago
It's actually hallucinating more. The more they mess with these now mature models, models which no longer scale with training corpus size, the more they push and prod at the models to do better with chain of thought and other techniques, the more they hallucinate. It's getting worse because the magic of LLM scaling is over and the techniques we have to make them better actually make the hallucinations worse.