4 ms·

They mean the ability to run a large model entirely on the GPU without paging it out of a separate memory system.

• bigyabai 1y ago
  They're basically describing the Jetson and Tegra lineup, then. Those were featured in several high-end consumer devices, like smart-cars and the Nintendo Switch.
  • nl 1y ago
    Sure but neither had enough memory to be useful for large LLMs. And neither were really consumer offerings.