4 ms·
This doesn't seem like the worst idea, but from a hardware perspective I'm not sure how an "AI PC" differs from machines with nice GPUs.
by debacle 3y ago
This doesn't seem like the worst idea, but from a hardware perspective I'm not sure how an "AI PC" differs from machines with nice GPUs.
- brookst 3y agoI’d welcome correction, but my understanding is that NPUs are “native” neural weight processors that trade the flexibility of doing graphics for the optimization of not having a layer like CUDA between neural net and hardware.
- mensetmanusman 3y agoThey are different enough that you could certainly add additional performance gains if you knew you were running LLaMa versus Fortnite.
- amelius 3y agoAn AI PC will have an AI App Store. Where Intel can reap like a 30% tax of all developer profits. Of course the hardware is the same, except for some features that allow Intel to lock it down hard.
- OJFord 3y agoYou could say the same about gaming PCs (ok, and LEDs). And less obviously about almost anything. So much is just marketing, including product design as a form of it.
- jdietrich 3y agoGPUs are increasingly optimised for machine learning workloads, but they aren't really designed for it on an architectural level and still leave a lot of potential performance and efficiency on the table. Current ML implementations are still quite kludgy and path-dependent, with lots of technical debt. There is huge potential for optimisation throughout the stack.