3 ms·
Have you shared it someplace besides Twitter for those of us who will not visit that site anymore? (much of the content requires login now too)
by verdverm 2y ago
Have you shared it someplace besides Twitter for those of us who will not visit that site anymore? (much of the content requires login now too)
- trzy 2y agoSure, I uploaded it to my YT: https://youtu.be/-iW3Vzzr3oU?si=QDhB3wxnP0KYvocl https://youtu.be/-iW3Vzzr3oU?si=QDhB3wxnP0KYvocl
- verdverm 2y agothanks & neat! It's been a while since I did any robotics tinkering. Thought about fine-tuning a pass the butter bot :] Have you seen the Aloha robot? Would be cool to see LLMs added to that, the price tag is a bit more at ~$35k... https://mobile-aloha.github.io/ https://mobile-aloha.github.io/
- trzy 2y agoI’m actually very interested in imitation learning and am building a system to do exactly this. It can be done much cheaper now, probably for about $7k total. I’ve replicated ALOHA’s ACT results using a cheap $250 table top arm but am very interested in doing something bigger, more complex, and useful. RoBart originally started as a way to build a cheap mobile base for a robot that could be operated and trained at home. Turns out that the hoverboard based set up isn’t quite optimal so for fun, I wanted to see how far I could push GPT-4 and Claude to autonomously operate it.
- verdverm 2y agoDid you find it useful? Did you use any other ML at the same time I think about the different aims of of YOLO object recognition vs LLM conversational vs RL for planning and how one might integrate them for a better overall system
- trzy 2y agoACT worked well and my repo is here: http://github.com/trzy/robot-arm http://github.com/trzy/robot-arm Re: LLM for supervising an imitation learning policy, check out the recent paper “Robot Utility Models” :) They even bought a TLD for it: https://robotutilitymodels.com/ https://robotutilitymodels.com/