4 ms·
Four V100s will do. They're about $1k each on ebay.
by MacsHeadroom 3y ago
Four V100s will do. They're about $1k each on ebay.
- astrodust 3y ago$1500 each, plus the server they go in, plus plus plus plus.
- MacsHeadroom 3y agoSure, but it's still a lot less than 8 h100s. ~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
- astrodust 3y ago$8K sounds like a lot more than "free".