4 ms·
> affordable commodity hardware, like a single server with 4x NVIDIA A6000 or 8x NVIDIA 3090 GPUs I need to seriously revise my definition of affordable commod
by iTokio 3y ago
> affordable commodity hardware, like a single server with 4x NVIDIA A6000 or 8x NVIDIA 3090 GPUs
I need to seriously revise my definition of affordable commodity hardware
- ronsor 3y agoNVIDIA's price gouging has distorted people's idea of "affordable"
- jetrink 3y agoYou can rent such a system for less than $4/hr. That sounds pretty affordable to me!
- withinboredom 3y agoThat's nearly minimum wage in most western countries, or a really nice living in some countries.
- nine_k 3y agoSpeaking of the US, it's roughly a price or a hamburger. If you can't afford a hamburger, your problems are likely not in compressing trillion-parameter models.
- avmich 3y agoSame if you're going to afford a hamburger every hour.
- thelastparadise 3y agoRight, that's about $3k/month.
- samus 3y agoRunning humongous models for the price of a small car? Yes, it's absolutely affordable. It's peanuts for all except the smallest, self-bootstrapped startups. Amortized it's way less than the expenses for data scientist and developers that can actually make full use of the cards.