4 ms·
> OpenAI’s models, including GPT-4, the backbone of Microsoft’s Copilot assistant, aren’t cheap to run. Keeping them live on Azure’s cloud infrastructure racks
by testplzignore 2y ago
> OpenAI’s models, including GPT-4, the backbone of Microsoft’s Copilot assistant, aren’t cheap to run. Keeping them live on Azure’s cloud infrastructure racks up significant costs, and Microsoft is eager to lower the bill with its own leaner alternatives.
Am I reading this right? Does Microsoft not eat its own dog food? Their own infra is too expensive?
- wejick 2y agoCost is cost wherever that would be.
- Etheryte 2y agoJust because you own a datacenter, doesn't mean it's free. For one, you still need to pay the power and bandwidth bills, both of which would be massive, and for two, every moment of compute you use internally is compute you're not selling for money.
- justsid 2y agoBut Microsofts replacement isn't going to magically run on air and love alone either. MS still ends up with the bill at the end of the day. Don't get me wrong, I think this is a good strategy for MS, but not for datacenter cost reasons.
- deleted 2y ago[deleted]