We've come a long way since the first LLMs were created. They originally produced a lot of surprises that were very hard to explain, it's true. But current rese

We've come a long way since the first LLMs were created. They originally produced a lot of surprises that were very hard to explain, it's true. But current research is very tightly directed at producing forward results; it's not just throw in more training data and make a bigger model and see what happens anymore (although there's still a bit of that too). The researchers have much more advanced understanding of how they work now, it just doesn't propagate out to the public which is still repeating "autocomplete on steroids" years later.