No idea how they got 10^28. There are only 10^11 neurons and their firing rate is 2*10^2. Even if you assume they do fp16 accumulation (which I doubt, it is unl

No idea how they got 10^28. There are only 10^11 neurons and their firing rate is 2*10^2. Even if you assume they do fp16 accumulation (which I doubt, it is unlikely they are that precise), that adds maybe 10^5 to the total of 2*10^18. That's a very optimistic estimate.