3 ms·
A world model can be used to learn something about the real system. I said synthesize because in the context that LLM's work in (using a corpus to generate sent
by tovej 9mo ago
A world model can be used to learn something about the real system. I said synthesize because in the context that LLM's work in (using a corpus to generate sentences) that is what that would look like.
- aurareturn 9mo agoWhy can’t an LLM run experiments to synthesize new facts?
- tovej 9mo agoThat's not what synthesis is. But that small semantic note aside, if an LLM is used to trigger other tools to find new facts, then those other tools are modeling the "world" or a particular domain. Alternatively you could say that the system as a whole, that the LLM is a part of, models the "world" or a particular domain.
- aurareturn 9mo agoDoes it matter how the new fact is acquired? If an LLM uses a calculator to come up with an answer, does it make it worse than a model that can inference the answer without using a tool?