3 ms·
Network weights would take up around 2TB. It also means at least 4TB of TPU/GPU memory required for training, or at least 50 Nvidia A100s.
by yobbo 5y ago
Network weights would take up around 2TB.
It also means at least 4TB of TPU/GPU memory required for training, or at least 50 Nvidia A100s.