3 ms·
You can build a decent rig for yourself with: - 2x 4070 Ti (32 GB total VRAM) - $2200 - 64 GB RAM - $200-250 - Core i9/Ryzen 9 CPU - $450 - 2 TB SSD - $150
by paxys 1y ago
You can build a decent rig for yourself with:
- 2x 4070 Ti (32 GB total VRAM) - $2200
- 64 GB RAM - $200-250
- Core i9/Ryzen 9 CPU - $450
- 2 TB SSD - $150
- Motherboard, cooler, case, PSU - $500-600
Total - ~$3500-3700, say $4000 with extras.
- flashgordon 1y agowow - do you mind sharing any links to a specific setup? Also whats the biggest model anybody has run on this?
- lossolo 1y agoUnfortunately, you will not be able to run any model on this that is comparable to the Claude models.
- paxys 1y agoYou can run a decent model on it, say highly quantized Qwen or Deepseek R1 getting 5-10 tokens/sec output, but it will be nothing in comparison to a commercial offering like Claude, o3 or Gemini. For that you need a datacenter-class GPU going for $50K-100K a pop.
- mtkd 1y agoBut a small collective running that box, especially spanning timezones, could potentially be a viable alternative or will be soon -- with obv privacy gains too
- icelancer 1y agoEvery model you run on that setup will be at best half as good as Sonnet 4.
- gaws 1y ago> - 2x 4070 Ti (32 GB total VRAM) - $2200 4070 card for $1,100? In this market?