3 ms·
> Are there genuine at scale use cases for AI outside of LLM's Assuming that "outside of LLMs" means "outside of text processing". Yes. Robotics. Imitation l
by krasin 2y ago
> Are there genuine at scale use cases for AI outside of LLM's
Assuming that "outside of LLMs" means "outside of text processing".
Yes. Robotics. Imitation learning with LLMs is working surprisingly well. It will require a lot of investments in data and training to get to a practical state, but all the early signs point that new revenue streams will be unlocked in Robotics.
One limitation that still stands on the way is the inference speed. My estimate is that we need ~10k tokens/sec prompt processing speed to get these smart robots working reasonably fast. We're getting there for 8B models (Groq & Cerebras silicon), but these 8B models are too dumb (especially, after being finetuned on robotics data), and 70B models are still 20x slower than practical.