If you want to make coffee at home, sure the amortized cost could be less than $10/mo. But, I wouldn’t consider that a fair comparison - probably running a code

If you want to make coffee at home, sure the amortized cost could be less than $10/mo. But, I wouldn’t consider that a fair comparison - probably running a code LLM locally could also turn out cheaper. We’re talking about paying others for the work instead of doing it ourselves. If not a coffee, eating out at a restaurant or buying an tshirt - anything can easily blow through $10 in one go. The problem is that the upfront GPU hardware is expensive, both for training and inference. You could save on electricity by relocating datacenters, but probably wouldn’t make a big difference. Sadly, geo-based pricing might be difficult for LLMs.