The power cost of inference and training is coming down exponentially. Deepmind v3 was trained for a tenth of what it cost to train equivalent performing models

The power cost of inference and training is coming down exponentially. Deepmind v3 was trained for a tenth of what it cost to train equivalent performing models a few months earlier. This is like saying digital electronic computers would never be economically and environmentally feasible if we had extrapolated out from the Z3 and ENIAC.