3 ms·
I wonder what will be the parallel hindsight about waste, but for matrix multiplications, in a few years.
by Zopieux 7mo ago
I wonder what will be the parallel hindsight about waste, but for matrix multiplications, in a few years.
- _heimdall 7mo agoBy then I understand that matrix multiplication will have cured cancer and invented unlimited free energy, so no hindsight of waste needed.
- echelon 7mo agoCure cancer? It doesn't have to cure cancer for it to make billions. All it has to do is put price pressure on your salary. (And it is already doing that.)
- xxpor 7mo agoThe economic incentives line up much better there. You charge for tokens -> cost is GPUs -> you work very hard to keep GPUs utilized 100% and get max tokens out of those cycles. Compare this to essentially any modern business app, the product being sold has very little relationship with CPU cycles, or the CPU cycles are SO cheap relative to what you're getting paid, no one cares to optimize.