5 ms·
Sure, but it's still a lot less than 8 h100s. ~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
by MacsHeadroom 3y ago
Sure, but it's still a lot less than 8 h100s.
~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
- astrodust 2y ago$8K sounds like a lot more than "free".