I was confused by this as well. Then I learned GPU are basically a bunch mutli-core with each core having a vector extensions and what Intel would call 'hypert

I was confused by this as well. Then I learned GPU are basically a bunch mutli-core with each core having a vector extensions and what Intel would call 'hyperthreading'. At least that how I think about it.