Yeah, it's a different compute/cost curve worth considering. On one hand, the cost of compute per token has gone down a lot, and will continue to go down, beca

Yeah, it's a different compute/cost curve worth considering. On one hand, the cost of compute per token has gone down a lot, and will continue to go down, because that's exactly the economic incentives at play. We had a little short-term nonsense where "the bigger the better" was all the rage, but inference was never this way, and now training is also pushing in this direction. But on the other hand, less compute per token means it can be more broadly deployed. And so there is likely more energy use, not less, in the long run.