3 ms·
Why the H100? Comparing against similarly priced consumer gear (3x 4090) makes a lot more sense, but I think you already know that one of these systems has an o
by NavinF 3y ago
Why the H100? Comparing against similarly priced consumer gear (3x 4090) makes a lot more sense, but I think you already know that one of these systems has an order of magnitude better perf/$ than the other
- iAkashPaul 3y agoYeah even that as well
- NavinF 3y agoNot sure if you missed my point. 3x 4090 will be 10x faster while costing the same. There's no point making the comparison. (Assuming both machines are running the same model. I see a lotta crazy numbers thrown around based on comparing very different quantizations)
- iAkashPaul 3y agoINT4 or FP4 ones are of interest to me