3 ms·
I doubt it. I see this as NVidia placing 50% of their bets on local models as the future, which it seems may be more profitable to them than cloud (sell 100/wh
by HarHarVeryFunny 2mo ago
I doubt it.
I see this as NVidia placing 50% of their bets on local models as the future, which it seems may be more profitable to them than cloud (sell 100/whatever local cards, which see 40hr/week max utilization, vs one cloud card seeing 24x7 utilization).
NVidia seem like a smart company - if they want to promote this direction they are not going to cripple it by trying to limit quantized models, even though you might expect them to promote benchmarks showing the benefits of larger and less quantized ones.
It's like the smart Intel of old - support CPUs all all price points, while also promoting CPU hogging applications like OpenCV.