3 ms·
This is all irrelevant. A language model should not run code itself, instead it should have a code execution environment, where it can read the error messages a
by visarga 4y ago
This is all irrelevant. A language model should not run code itself, instead it should have a code execution environment, where it can read the error messages and iterate. It's terribly inefficient and error prone to run code directly.
People also code on computers, not on paper.
- nl 4y agoThe point is to develop good intuitions for how large language models behave. If someone can develop a differentiable script runner that would be great! But the intuition about how the language model is behaving is useful for more than this specific problem.