Interesting, the 8B model was trained for 1.3M hours, while the 70B for 6.4M hours at 700W. Assuming $0.05/kWh (WA price) it's $46k and $224k. Even allowing for

Interesting, the 8B model was trained for 1.3M hours, while the 70B for 6.4M hours at 700W. Assuming $0.05/kWh (WA price) it's $46k and $224k. Even allowing for cooling, CPUs, and more expensive power wherever they are running this, still well less than $1M in power. I somehow thought it would be much more. The nVidia bill is another matter - assuming 5 year amortization and $45k H100, it works out $1/h, so $8M or so.