2 ms·
Can you please argue your case? I argue that the model’s weights could contain a rich representation of the world, even if it looks different from that of huma
by dwaltrip 3y ago
Can you please argue your case?
I argue that the model’s weights could contain a rich representation of the world, even if it looks different from that of humans. And that it can use this capability of world modeling to also make new connections.
These “world modeling” / “reasoning” abilities seem to have some similarities with that of humans. We see echoes of our own abilities in gpt-4 and the like. But they also have their own peculiarities and limitations, which isn’t surprising in hindsight.