3 ms·
Pretty much the same as what you see in the comments here. For certain workloads, NPU is faster than CPU by quite a bit, and I think he gave some detailed examp
by throwaway293892 9mo ago
Pretty much the same as what you see in the comments here. For certain workloads, NPU is faster than CPU by quite a bit, and I think he gave some detailed examples at the low level (what types of computations are faster, etc).
But nothing that translated to real world end user experience (other than things like live transcription). I recall I specifically asked "Will Stable Diffusion be much faster than a CPU?" in my question.
He did say that the vendors and Microsoft were trying to come up with "killer applications". In other words, "We'll build it, and others will figure out great ways to use it." On the one hand, this makes sense - end user applications are far from Intel's expertise, and it makes sense to delegate to others. But I got the sense Microsoft + OEMs were not good at this either.
- hulitu 9mo ago> For certain workloads, NPU is faster than CPU by quite a bit WTF is an NPU ? What kind of instructions does it support ? Can it add 3 and 5 ? Can it compute matrices ?
- cyanydeez 9mo agoNeural Processing Unit. A retarded GPU that does matrix multiplication. https://en.wikipedia.org/wiki/Neural_processing_unit https://en.wikipedia.org/wiki/Neural_processing_unit In theory, its your math coprocessor for your 386.
- hulitu 9mo ago> In theory, its your math coprocessor for your 386. A math coprocessor, AFAIK, can do much more than matrix multiplications. From my POV, having a separate chip doing a single math operation is (so 1970) lame.