2 ms·
Where do you think GPT-3 was trained and currently runs? In Azure. It doesn't need TPUs.
by visarga 4y ago
Where do you think GPT-3 was trained and currently runs? In Azure. It doesn't need TPUs.
- adammarples 4y agoGpt3 is an impressive model, I think it took 512 GPUs 10 days to train though. This alone doesn't mean that Microsoft has more computing power than Google
- hot_gril 4y agoIt does mean that you don't need the most computing power to train a successful model.