2 ms·
An important missing piece in the price analysis is that the M3 chip is not designed for continuous load. It's the difference between retail and datacenter/comm
by danny_codes 3y ago
An important missing piece in the price analysis is that the M3 chip is not designed for continuous load. It's the difference between retail and datacenter/commercial hardware. You can get an RTX-4090 for 1500. But if you try to train on it for ~a few months it will almost certainly die. There's a reason datacenter hardware has a 5-10x price premium.
- thebitstick 3y agoLocal LLM use isn't really continuous though. You're comparing Apples to oranges. For training especially and for the datacenter, NVIDIA cards still make absolute sense. But for consumer use cases, and even for developers, it's not so cut and dry. Very comparable performance for short-term bursts of compute.