3 ms·
Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.
by renewiltord 3y ago
Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.
- 1024core 3y ago"TPUs" are a Google-only product, available* only on GCP. * Notwithstanding the Choral boards
- memossy 3y agoWe use v4s, v5es & v5ps. Mostly v5ps, very stable int8 training (versus the horror that is fp8 stability)
- MasterScrat 3y agoWe started on V3s, now fully moved to V4s with some V5Es, investigating a full move towards V5E & V5P