3 ms·
It’s not larger than Microsoft’s? https://blogs.microsoft.com/ai/openai-azure-supercomputer/ https://blogs.microsoft.com/ai/openai-azure-supercomputer/
by buildbot 5y ago
It’s not larger than Microsoft’s? https://blogs.microsoft.com/ai/openai-azure-supercomputer/ https://blogs.microsoft.com/ai/openai-azure-supercomputer/
- boulos 5y agoThat was a V100 cluster though. 10k V100s is less powerful (for ML stuff) than ~6k A100s.
- forgotmyoldacc 5y agoFacebook's > When RSC is complete, the InfiniBand network fabric will connect 16,000 GPUs as endpoints Microsoft's > The supercomputer developed for OpenAI is a single system with more than 285,000 CPU cores, 10,000 GPUs and 400 gigabits per second of network connectivity for each GPU server