4 ms·
I suspect it's less pre-trained than you think, the tweet is prefaced with a message that all actions are driven by neural networks indicating that it's probabl
by KoolKat23 3y ago
I suspect it's less pre-trained than you think, the tweet is prefaced with a message that all actions are driven by neural networks indicating that it's probably adjusting for the objects, the environment etc.
- tintor 3y agoIt is safe to assume it works only for that specific demo, and nothing else.
- modeless 3y agoI think it's true that it can adjust, somewhat. I expect that it could handle slight variations such as moving any of the items on the table around by a few inches, or adding or removing a couple of plates from the rack. However, I do not expect that it could handle larger variations like replacing the apple with a pineapple, picking trash out of the dish rack or the cup instead of the plate, replacing the cup with a coffee mug, or sliding the dish rack over to the other side of the robot. I'd love to be wrong but I expect that if they had that much flexibility in their controllers they would have demonstrated it.
- KoolKat23 3y agoI'm sure there is definitely some limitation in this demo, but who knows, Google RT-2 exists after all. Enough shapes and object training will save the day, there's still objects me as a human would be new to handling.
- modeless 3y agoOh for sure these limitations will fall. It's only a matter of time (and a lot of work behind the scenes). Covariant's RFM-1 (announced Monday) is an interesting approach to generality. https://www.youtube.com/watch?v=1Go6HEC-bYU https://www.youtube.com/watch?v=1Go6HEC-bYU