3 ms·
The robot movements are separate end-to-end neural networks. They're triggered by the LLM but aren't hardcoded.
by famouswaffles 3y ago
The robot movements are separate end-to-end neural networks. They're triggered by the LLM but aren't hardcoded.
- margorczynski 3y agoWhy does it then after performing an action or whole plan return to the "default" position with the hands in that strange stance? Looks kinda like there is some "hard coded" flow that simply uses the LLM(s) to perform actions.
- famouswaffles 3y agoThat's a closed loop operation. It's pretty common to train these robots on closed loop demonstrations.
- huytersd 3y agoDo you know this for a fact or are you speculating?
- StarCyan 3y agoOne of the Figure engineers described the system at a high level: https://twitter.com/coreylynch/status/1767927506332721154 https://twitter.com/coreylynch/status/1767927506332721154