4 ms·
Using LLM to translate the end result (text) into controls could be just a form of code generation, for which LLM are superb at. I think a critical piece is be
by karmasimida 4y ago
Using LLM to translate the end result (text) into controls could be just a form of code generation, for which LLM are superb at.
I think a critical piece is being figured out as more and more such research emerges.
- andreyk 4y agoFYI, translation to code was actually already done last year by Google (Code as Policies - https://lastweekin.ai/p/code-as-policies https://lastweekin.ai/p/code-as-policies) - but this still assumes a set of low level primitives, not tight visuomotor control. You really need reactive policies with tight feedback loops in many robotics domains, and that's kind of hard with these super gigantic models.