2 ms·
Paying for LLM inference by the kilowatt-hour instead of per token
- jqpabc123 3mo agoAI is an energy problem. Marketplace success will likely be determined by energy costs as much if not more so than the technical aspects of model development.
loading thread…