4 ms·
Availability only on GCP and in particular cost.
by boyka 3y ago
Availability only on GCP and in particular cost.
- fulafel 3y agoGoogle has advertised that they have better perf/$ than GPUs, is this wrong or do you just mean absolute cost (so not available in small enough slices)? edit: actually now i can't find the claim, maybe i misremember what the papers said.
- mochomocha 3y agoPerf/$ where $ is what it cost _them_ , not $ they're ready to sell to others as a product. Cloud margins in the high two-digit percents are typical, and I'd imagine even higher for very specialized products in high-demand from deep-pocketed customers.
- sanxiyn 3y agohttps://arxiv.org/abs/2304.01433 https://arxiv.org/abs/2304.01433 does claim "1.2x-1.7x faster and uses 1.3x-1.9x less power than the NVIDIA A100".