5 ms·
>For all of the hype around LLMs, this general area (image generation and graphical assets) seems to me to be the big long-term winner of current-generation AI.
by llm_trw 2y ago
>For all of the hype around LLMs, this general area (image generation and graphical assets) seems to me to be the big long-term winner of current-generation AI.
Let me show you the future: https://www.youtube.com/watch?v=eVlXZKGuaiE https://www.youtube.com/watch?v=eVlXZKGuaiE
This is an LLM controlling an embodied VR body in a physics simulation.
It is responding to human voice input not only with voice but body movements.
Transformers aren't just chatbots, they are general symbolic manipulation machines. Anything that can be expressed as a series of symbols is a thing they can do.
- latentsea 2y ago>This is an LLM controlling an embodied VR body in a physics simulation. No it's not. It's VAM that is controlling the character and it's literally just using a bog standard LLM as a chatbot and feeding the text into a plugin in VAM and VAM itself does the animation. Don't get me wrong it's absolutely next level to experience chatbots this way, but it's still a chat bot.
- llm_trw 2y agoThe animation, not the movement decisions. This is as naive as calling an industrial robot 'just a calculator'.
- latentsea 2y agoThe movement decisions are also just text from the LLM and are heavily coupled with what's available in the scene. It's not some free autonomous agent. Nor was the movement decisions trained any special type of tokens other than just text.