3 ms·
Google has been at the forefront AI for years, decades maybe. Do azure even have tpus? It's reasonable to assume Google have close to the best ML compute resour
by adammarples 4y ago
Google has been at the forefront AI for years, decades maybe. Do azure even have tpus? It's reasonable to assume Google have close to the best ML compute resources out of probably everyone in the world.
- visarga 4y agoWhere do you think GPT-3 was trained and currently runs? In Azure. It doesn't need TPUs.
- adammarples 4y agoGpt3 is an impressive model, I think it took 512 GPUs 10 days to train though. This alone doesn't mean that Microsoft has more computing power than Google
- hot_gril 4y agoIt does mean that you don't need the most computing power to train a successful model.