How much resources would it take to train something like this? Let's say in RTX-3090 months, or in $ running on AWS (or whoever offers TPUs)? In the link it sa

How much resources would it take to train something like this? Let's say in RTX-3090 months, or in $ running on AWS (or whoever offers TPUs)? In the link it says training FLOPs: 1.5e22, a RTX 3090 has 285 TFLOPS/sec for tensor operations. If you can actually calculate it like that, 1000 GPUs would take 20 months. https://www.google.com/search?q=1.5e22+%2F+%281000+*+285e9+%2F+s%29+in+months https://www.google.com/search?q=1.5e22+%2F+%281000+*+285e9+%... Working with grid computing at CERN, I've had access to some pretty big computing resources myself, but the scale of this is mind-boggling...