3 ms·
AFAIK NVidia has a VLA running on their chips with 2B params at 10Hz. They’ve openly published a .5B model running at 10Hz
by CardenB 2mo ago
AFAIK NVidia has a VLA running on their chips with 2B params at 10Hz. They’ve openly published a .5B model running at 10Hz
- YuechenLi 2mo ago10Hz is still a 0.1s of latency, which doesn't seem like a lot until you realize that an Arduino typically runs at 16 Mhz, which is literally a million times faster than running a full LLM. So, yeah, for complex reasoning and sensory processing, LLMs are the correct choice, and Gemini is especially strong at spatial reasoning over ChatGPT/Claude. But for actual motion/actuation? LLMs are the wrong tool for the job, probably easier to have LLMs program a reusable workflow in a script for repeated tasks instead of invoking LLMs after the first time.
- SparkyMcUnicorn 2mo ago16 MHz is the chip's clock speed. Arduino PID is more like 100 Hz to 1 kHz. Human deliberate movement runs around 2-10 Hz I think.
- CardenB 2mo agoFor this operating domain the latency comparison is human reaction time and not arduino reaction time. Also the process that’s running at 16MHz is not the same as a full VLA. VLA is much more expressive. You think the processor that is running the VLA system is running at 10Hz or some GHz?