Right, I think the insight that LLMs "create" though is via compression of knowledge in new ways. It's like teaching one undergraduate (reading some blog on th

Right, I think the insight that LLMs "create" though is via compression of knowledge in new ways. It's like teaching one undergraduate (reading some blog on the internet and training on next word prediction), then another undergraduate (training on another blog), then another one, etc. And finding a way to store what's in common among all these undergraduates. Over time, it starts to see commonalities and to become more powerful than a human. Or a human who had taught a million undergraduates. But it's not just at the undergraduate level. It's the most abstract/efficient way to represent the essence of their ideas. And in math that's the whole ball game.