2 ms·
> matmult would be in transformer-optimized hardware It is... it's in GPUs lol > first class in torch It is > costing a fraction of GPUs Why would anyone g
by almostgotcaught 1y ago
> matmult would be in transformer-optimized hardware
It is... it's in GPUs lol
> first class in torch
It is
> costing a fraction of GPUs
Why would anyone give you this for cheaper than GPUs lol?
- atty 1y agoI think they’re referring to hardware like TPUs and other ASICs. Which also exist, of course :)
- almostgotcaught 1y agoSure but GPUs literally have MMA engines now