3 ms·
I agree that some of the talk about neurons in LLMs can be a bit much, but don't you have a model in your head of how the world is composed of forces, and you c
by fragmede 2y ago
I agree that some of the talk about neurons in LLMs can be a bit much, but don't you have a model in your head of how the world is composed of forces, and you can generally predict how things react? If you throw a ball up in the air, will it come down or just go up forever?
Or are we using different definitions for "world model"?
- astrange 2y agoI think the words "a" and "model" in "a world model" are both bad. People do that sometimes (for instance I was at the Ren Faire recently and aimed the bow when I tried archery), but people are limited by time and calories so must be energy-efficient, which means they can't afford to spend effort making a model that isn't necessary. And what's necessary is very specific to the task or context you're in. For instance, you don't need to know what's in the garbage to throw it out. But you do need to know what's in the recycling to put it in the right bin.