4 ms·

Never mind cannibalising (?) the market. There have already been several ChatGPT outages caused by a lack of compute capacity. Azure literally cannot buy Nvid

Never mind cannibalising (?) the market. There have already been several ChatGPT outages caused by a lack of compute capacity. Azure literally cannot buy Nvidia GPUs fast enough to satisfy customer demand. They are forced to buy alternatives here. There's no real decision to make here.

capableweb 3y ago
The outages you're talking about were at OpenAI, and doesn't seem to have impacted Microsoft's service at all.
- simse 3y ago
  But isn't the entirety of OpenAI compute on Azure?
  - latchkey 3y ago
    https://www.cnbc.com/2023/06/01/microsoft-inks-deal-with-coreweave-to-meet-openai-cloud-demand.html https://www.cnbc.com/2023/06/01/microsoft-inks-deal-with-cor... https://www.reuters.com/markets/deals/microsoft-inks-computing-infra-deal-with-coreweave-cnbc-2023-06-01/ https://www.reuters.com/markets/deals/microsoft-inks-computi...
    - simse 3y ago
      thanks for sharing, I didn't know
  - mike_d 3y ago
    Azure is now leasing capacity from Oracle.
    - latchkey 3y ago
      That's for databases. https://news.microsoft.com/2023/09/14/microsoft-and-oracle-expand-partnership-to-deliver-oracle-database-services-on-oracle-cloud-infrastructure-in-microsoft-azure/ https://news.microsoft.com/2023/09/14/microsoft-and-oracle-e...
      - mike_d 3y ago
        GPUs https://www.techradar.com/pro/microsoft-is-renting-gpu-power-from-oracle-to-push-its-ai-work-forward https://www.techradar.com/pro/microsoft-is-renting-gpu-power... Specifically for the parts of Bing that are rebranded OpenAI https://www.oracle.com/news/announcement/oracle-cloud-infrastructure-utilized-by-microsoft-for-bing-conversational-search-2023-11-07/ https://www.oracle.com/news/announcement/oracle-cloud-infras...
        latchkey 3y ago
        Interesting, thanks!
vitorgrs 3y ago
Microsoft is now literally buying Oracle compute to satisfy Bing AI demand. https://www.oracle.com/news/announcement/oracle-cloud-infrastructure-utilized-by-microsoft-for-bing-conversational-search-2023-11-07/ https://www.oracle.com/news/announcement/oracle-cloud-infras...
- epolanski 3y ago
  Well, they are forcing bing ai on all users and all queries, I don't think I've ever looked at the output, and yet they keep shelling important money every query I make.

capableweb 3y ago

The outages you're talking about were at OpenAI, and doesn't seem to have impacted Microsoft's service at all.

simse 3y ago
But isn't the entirety of OpenAI compute on Azure?
- latchkey 3y ago
  https://www.cnbc.com/2023/06/01/microsoft-inks-deal-with-coreweave-to-meet-openai-cloud-demand.html https://www.cnbc.com/2023/06/01/microsoft-inks-deal-with-cor... https://www.reuters.com/markets/deals/microsoft-inks-computing-infra-deal-with-coreweave-cnbc-2023-06-01/ https://www.reuters.com/markets/deals/microsoft-inks-computi...
  - simse 3y ago
    thanks for sharing, I didn't know
- mike_d 3y ago
  Azure is now leasing capacity from Oracle.
  - latchkey 3y ago
    That's for databases. https://news.microsoft.com/2023/09/14/microsoft-and-oracle-expand-partnership-to-deliver-oracle-database-services-on-oracle-cloud-infrastructure-in-microsoft-azure/ https://news.microsoft.com/2023/09/14/microsoft-and-oracle-e...
    - mike_d 3y ago
      GPUs https://www.techradar.com/pro/microsoft-is-renting-gpu-power-from-oracle-to-push-its-ai-work-forward https://www.techradar.com/pro/microsoft-is-renting-gpu-power... Specifically for the parts of Bing that are rebranded OpenAI https://www.oracle.com/news/announcement/oracle-cloud-infrastructure-utilized-by-microsoft-for-bing-conversational-search-2023-11-07/ https://www.oracle.com/news/announcement/oracle-cloud-infras...
      - latchkey 3y ago
        Interesting, thanks!

vitorgrs 3y ago

Microsoft is now literally buying Oracle compute to satisfy Bing AI demand. https://www.oracle.com/news/announcement/oracle-cloud-infrastructure-utilized-by-microsoft-for-bing-conversational-search-2023-11-07/ https://www.oracle.com/news/announcement/oracle-cloud-infras...

epolanski 3y ago
Well, they are forcing bing ai on all users and all queries, I don't think I've ever looked at the output, and yet they keep shelling important money every query I make.