They're actually kind of not, but they're good at vector multiplication. Matrix multiplication is just stacked vector multiplication, so GPUs are okay at matri

They're actually kind of not, but they're good at vector multiplication. Matrix multiplication is just stacked vector multiplication, so GPUs are okay at matrix multiplication (but not as good as one could imagine they could be). I think TPUs were the first thing really designed to do matrix multiplication