3 ms·
>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. You should do some basic maths; the megawatts are used for serving many LLM
by logicchains 1y ago
>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts.
You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance.
- rhdhfjej 1y agoYes, the cost figures published by LLM labs imply a power consumption measured in megawatts for each instance of top performance frontier models. Take the L.