2 ms·
It's pretty much happening already. Apple devices have MPS. Both new Intels and Snapdragon X have some form of NPU.
by viraptor 2y ago
It's pretty much happening already. Apple devices have MPS. Both new Intels and Snapdragon X have some form of NPU.
- moffkalast 2y agoIt would be great if any NPU that currently exists was any good at LLM acceleration, but they all have really bad memory bottlenecks.