3 ms·
oh so that is the doc they shared with the higher-ups? as for your question, https://arxiv.org/pdf/2201.08239.pdf https://arxiv.org/pdf/2201.08239.pdf states 2
by GalahiSimtam 4y ago
oh so that is the doc they shared with the higher-ups?
as for your question, https://arxiv.org/pdf/2201.08239.pdf https://arxiv.org/pdf/2201.08239.pdf states 2 months of 1024 TPUv3 for a pre-training, and TPUv3 isn't even the most recent TPU hardware
- JohnJamesRambo 4y agoThank you for your response. So it is trained on 1024 TPUs but then if I chat with it today, what is it running on?