3 ms·
For inference we do not care about training, right? But if we could make cheaper inference machines available, everyone would profit. Isn't it that LLMs use m
by roflmaostc 1y ago
For inference we do not care about training, right?
But if we could make cheaper inference machines available, everyone would profit.
Isn't it that LLMs use more energy in inference than training these days?