3 ms·
Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. That's 5-6 orders of magnitude difference, despite our semiconductors having
by rhdhfjej 1y ago
Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. That's 5-6 orders of magnitude difference, despite our semiconductors having a lithographic feature size that's also orders of magnitude smaller than our biological neurons. You should do some more research.
- adrian_b 1y agoThe TDP of a typical human brain is not 15 W, but 25 W, so about the same as for many notebook or mini-PC CPUs, but otherwise your argument stands. The idle power consumption of a human is around 100 W.
- logicchains 1y ago>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts. You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance.
- rhdhfjej 1y agoYes, the cost figures published by LLM labs imply a power consumption measured in megawatts for each instance of top performance frontier models. Take the L.