2 ms·
TaskType: Action with arm: pick_up_glass Is that preprogrammed, or is the LLM doing that?
by Animats 2y ago
TaskType: Action with arm: pick_up_glass
Is that preprogrammed, or is the LLM doing that?
- apeytavin 2y agoThe LLM is deciding to use that skill at that time. The skill itself was trained beforehand by the user like shown in the docs, and the agent has information about what kind of context the task can be used in and recognizes that here is the right moment EDIT: I say LLM but it's really not just an LLM. From the outside perspective it looks like it because we decided to do so, but under the hood it's multiple models (as described in the post)
- Animats 2y agoSee the famous paper "Put That There", from 1982.[1] [1] https://www.media.mit.edu/publications/put-that-there-voice-and-gesture-at-the-graphics-interface/ https://www.media.mit.edu/publications/put-that-there-voice-...