3 ms·
$1500 each, plus the server they go in, plus plus plus plus.
by astrodust 2y ago
$1500 each, plus the server they go in, plus plus plus plus.
- MacsHeadroom 2y agoSure, but it's still a lot less than 8 h100s. ~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
- astrodust 2y ago$8K sounds like a lot more than "free".