How much do we need to progress before it becomes comparable in terms of energy to the (often already rather energy-inefficient) data pipelines we've been using

How much do we need to progress before it becomes comparable in terms of energy to the (often already rather energy-inefficient) data pipelines we've been using so far? Recall that while the cost per token may decrease, CoT multiplies the number of tokens by several orders of magnitude.