3 ms·
>> With our advances in long-term reasoning and planning, Devin can plan and execute complex engineering tasks requiring thousands of decisions. They'd better
by YeGoblynQueenne 3y ago
>> With our advances in long-term reasoning and planning, Devin can plan and execute complex engineering tasks requiring thousands of decisions.
They'd better have really advanced reasoning and planning capabilities way beyond everything that anyone else knows how to do with LLMs. There's a growing body of literature that leaves no doubt that LLMs can't reason and can't plan.
For a quick summary of some such results see:
https://arxiv.org/pdf/2403.04121.pdf https://arxiv.org/pdf/2403.04121.pdf
- E_Bfx 3y ago'plan' is an ambigous word. 'plan' for Devin means break a complexe task in subtask and then generate code. Whereas 'plan' in the paper you link is never define, so I am not sure what his author want to demonstrate, that LLM doesn't have free will ? that LLM are not universal problem solve ? It is a quite confuse paper.
- YeGoblynQueenne 3y agoPlans and planning have precise formal definitions, probably not included in the article I linked because it is a short commentary article. See e.g. the following for the standard definitions: http://www.spacebook-project.eu/pubs/CogSci-13.pdf http://www.spacebook-project.eu/pubs/CogSci-13.pdf