4 ms·
Finetuning LLMs is currently the most promising way for next-gen robotics. One of such works (PaLM-e) among other things measured the impact of finetuning on ge
by krasin 3y ago
Finetuning LLMs is currently the most promising way for next-gen robotics. One of such works (PaLM-e) among other things measured the impact of finetuning on general purpose tasks: https://twitter.com/DannyDriess/status/1632904698108821505 https://twitter.com/DannyDriess/status/1632904698108821505
In short, an 8B model could degrade almost 10x after being finetuned on robotics tasks, while 500B model experiences a very minor degradation (~4%) and there's a hope that with a larger-sized model, it could become either zero or even negative (adding more experience improves general purpose reasoning).
What I am saying is that while GPT-4 could beat a finetuned GPT-3.5 class model, I predict good things about finetuned GPT-4 class models, when they become practical outside of OpenAI/Google.
- TMWNN 3y ago>there's a hope that with a larger-sized model, it could become either zero or even negative (adding more experience improves general purpose reasoning). The best single work of fiction ever created about LLMs' capabilities (and, perhaps, dangers) is Colossus by Jones. Although I think the film is even better than the book, only the latter mentions how, despite being created specifically for US national defense, Colossus is also fed unrelated data including Shakespeare's sonnets, because its creators do not know if it could be important.
- paulmd 3y agoWhat good is a revolution without dancing?
- gradascent 3y agoInteresting! I would like to learn more about how AI is being applied to robotics. Do you have any suggestions for how to keep up with developments/ideas in this field?
- krasin 3y agoThese two links could be a good start: ALOHA-2: https://aloha-2.github.io/ https://aloha-2.github.io/ RT-X: https://robotics-transformer-x.github.io/ https://robotics-transformer-x.github.io/
- hlfshell 3y agoIn October I wrote a blogpost on this subject: https://hlfshell.ai/posts/llms-and-robotics-papers-2023/ https://hlfshell.ai/posts/llms-and-robotics-papers-2023/ ..and plan to do an updated version soon for much of what's been released since. I've also done work related to LLM and robotics integration, also on that site. Happy to chat about it.
- newswasboring 3y agoWorking my way through your blog post and it is so refreshing. Unfortunately my algorithm currently is showing me takes which are extreme on either end (like in your blog post). > Technology’s largest leaps occur when new tools are provided to those that want to make things. I love this sentence. And the general attitude of curiosity of your post.
- hlfshell 3y agoThanks! Appreciate the kind words. I should have in the next month or so (interviewing and finishing my Master's, so there's been delays) a follow up that follows more advancements in the router style VLA, sensoiromotor VLM, and advances in embedding enriched vision models in general. If you want a great overview of what a modern robotics stack would look like with all this, https://ok-robot.github.io/ https://ok-robot.github.io/ was really good and will likely make it into the article. It's a VLA combined with existing RL methods to demonstrate multi-tasking robots, and serves as a great glimpes into what a lot of researchers are working on. You won't see these techniques in robots in industrial or commercial settings - we're still too new at this to be reliable or capable enough to deploy these on real tasks.