"There have been continuous efficiency savings innovations for both training and inference over the last few years." I'm aware - i've run the relevant teams at

"There have been continuous efficiency savings innovations for both training and inference over the last few years." I'm aware - i've run the relevant teams at large scale companies like Google :) Is your claim anyone has made 98% total vs, say, 5 years ago? If so, evidence please? Otherwise, seems sort of irrelevant. AFAIK, nobody has come anywhere close to this, and the only possible way they would is through externalizing roughly all costs onto someone else. (IE certainly google TPU's are much more efficient than 5 years ago, but since you have to account for development cost, they are not saving 98% vs 5 years ago)