5 ms·
For on prem use, the up front cost is a lot lower. The A100 that most serious outfits are using runs in the thousands to tens of thousands of dollars per unit w
by hadlock 3y ago
For on prem use, the up front cost is a lot lower. The A100 that most serious outfits are using runs in the thousands to tens of thousands of dollars per unit with very limited availability. The pi is typically under $75 usd for any variant.
- speedgoose 3y agoA RTX 4090 has a much better value for stable diffusion but yes if you start to think about cost the pi wins. If you think about availability, I’m not sure.
- hadlock 3y agoThe big immediate plus here, is if you live somewhere with limited access to the internet, you can still generate imagery offline on a low end laptop, like a protest group in far eastern europe or other areas. My personal travel laptop only has 8GB memory so it's exciting to be able to try out an idea even if I don't have high end hardware.
- PeterStuer 3y agoAn RTX 3090 hits the current sweetspot of price/performance for me. Half the throughput of the 4090, but at 1/3rd the cost. (I needed the 24GB VRAM for other LLM projects).
- arvinsim 3y agoIs this brand new or used?
- adventured 3y agoUsed is the only way to get a 3090 for ~$650-$750 (they're not hard to find on eBay in that general price area).
- PeterStuer 3y agoUsed from ebay in my case.