3 ms·
MatMult = the dot product, effectively. I can't believe that allowing smaller vectors is difficult or even non-trivial in hardware.
by zasdffaa 4y ago
MatMult = the dot product, effectively. I can't believe that allowing smaller vectors is difficult or even non-trivial in hardware.
- svnt 4y agoYou’re assuming caches know anything about dot products.
- zasdffaa 4y agoThat seems a non-sequiteur to me. Can you elaborate?
- WithinReason 4y agoGPUs are a good example: SIMD means all 128 threads do the same work. If only 1 thread has work to do the other 127 threads still take up resources.
- zasdffaa 4y agoAh, right, gotcha
- deleted 4y ago[deleted]