3 ms·
>There's no way to offer the power of a $1,000 GPU without your own $1,000 GPU I think the whole idea of economics at scale (and much of cloud computing) is pr
by drusepth 7y ago
>There's no way to offer the power of a $1,000 GPU without your own $1,000 GPU
I think the whole idea of economics at scale (and much of cloud computing) is predicated on the idea that users want to use that $1,000 GPU without having to pay $1,000 to own it, and that companies can sell access to many users per $1,000 GPU to recoup the costs of that GPU, both over time (as the initial cost gets amortized over recurring subscription/usage revenues) and horizontally (selling access to many users who timeshare that GPU, maximizing its use compared to owning one you'd only use N hours per day).
Scale that up to thousands of GPUs making a profit from hundreds of thousands of users each accessing those resources at a cost cheaper than what it'd take for them to purchase those resources for themselves and you've got the magic of the "cloud".
tl;dr Users can pay <$1,000 for access to a $1,000 GPU and companies can afford to do so because the number of users multiplied by what they're paying exceeds the cost and upkeep of that GPU. Everyone* wins.