3 ms·
> Commodity hardware and software will continue to drop in price. The software is free (citation: Cuda, nvcc, llvm, olama/llama cpp, linux, etc) The hardware
by hugmynutus 8mo ago
> Commodity hardware and software will continue to drop in price.
The software is free (citation: Cuda, nvcc, llvm, olama/llama cpp, linux, etc)
The hardware is *not* getting cheaper (unless we're talking a 5+ year time) as most manufacturers are signaling the current shortages will continue ~24 months.
- denimnerd42 8mo agoGB300 NVL72 is 50% more expensive than GB200 I've heard.
- eru 8mo ago> The hardware is not getting cheaper (unless we're talking a 5+ year time) Yes, that's the time I'm talking about. You also had a blip with increasing hard disk prices when Thailand flooded a few years ago.
- shykes 8mo ago> The software is free (citation: Cuda, nvcc, llvm, olama/llama cpp, linux, etc) If you factor in the cost of integration and ongoing maintenance - by humans or llms - it is not free. But it certainly has never been cheaper.