4 ms·
thanks & neat! It's been a while since I did any robotics tinkering. Thought about fine-tuning a pass the butter bot :] Have you seen the Aloha robot? Would be
by verdverm 2y ago
thanks & neat! It's been a while since I did any robotics tinkering. Thought about fine-tuning a pass the butter bot :]
Have you seen the Aloha robot? Would be cool to see LLMs added to that, the price tag is a bit more at ~$35k...
https://mobile-aloha.github.io/ https://mobile-aloha.github.io/
- trzy 2y agoI’m actually very interested in imitation learning and am building a system to do exactly this. It can be done much cheaper now, probably for about $7k total. I’ve replicated ALOHA’s ACT results using a cheap $250 table top arm but am very interested in doing something bigger, more complex, and useful. RoBart originally started as a way to build a cheap mobile base for a robot that could be operated and trained at home. Turns out that the hoverboard based set up isn’t quite optimal so for fun, I wanted to see how far I could push GPT-4 and Claude to autonomously operate it.
- verdverm 2y agoDid you find it useful? Did you use any other ML at the same time I think about the different aims of of YOLO object recognition vs LLM conversational vs RL for planning and how one might integrate them for a better overall system
- trzy 2y agoACT worked well and my repo is here: http://github.com/trzy/robot-arm http://github.com/trzy/robot-arm Re: LLM for supervising an imitation learning policy, check out the recent paper “Robot Utility Models” :) They even bought a TLD for it: https://robotutilitymodels.com/ https://robotutilitymodels.com/