3 ms·

People like to pretend that AGI isn't going to cost money to run. The power budget alone is something no one is contemplating. Technology doesn't accelerate e

People like to pretend that AGI isn't going to cost money to run. The power budget alone is something no one is contemplating. Technology doesn't accelerate endlessly. Only our transistor spacing does. These two are not the same thing.

dr_dshiv 2y ago
Power budget will drop like a rock over time. Exponential increases in cost (and power) for next-level AI and exponential decreases for the cost (and power) of current level AI.
bigbones 2y ago
More efficient hardware mappings will happen, and as a sibling comment says, power requirements will drop like a rock. Check out https://www.youtube.com/watch?v=7hz4cs-hGew https://www.youtube.com/watch?v=7hz4cs-hGew for some idea of what that might eventually look like
WillPostForFood 2y ago
The power budget alone is something no one is contemplating. It is very hard to find a discussion about the growth and development of AI that doesn't discuss the issues around power budget. https://www.datacenterknowledge.com/energy-power-supply/white-house-backs-nuclear-energy-for-data-centers https://www.datacenterknowledge.com/energy-power-supply/whit... https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2025/01/14/executive-order-on-advancing-united-states-leadership-in-artificial-intelligence-infrastructure/ https://bidenwhitehouse.archives.gov/briefing-room/president... In building domestic AI infrastructure, our Nation will also advance its leadership in the clean energy technologies needed to power the future economy, including geothermal, solar, wind, and nuclear energy; foster a vibrant, competitive, and open technology ecosystem in the United States, in which small companies can compete alongside large ones; maintain low consumer electricity prices; and help ensure that the development of AI infrastructure benefits the workers building it and communities near it.

dr_dshiv 2y ago

Power budget will drop like a rock over time. Exponential increases in cost (and power) for next-level AI and exponential decreases for the cost (and power) of current level AI.

bigbones 2y ago

More efficient hardware mappings will happen, and as a sibling comment says, power requirements will drop like a rock. Check out https://www.youtube.com/watch?v=7hz4cs-hGew https://www.youtube.com/watch?v=7hz4cs-hGew for some idea of what that might eventually look like

WillPostForFood 2y ago

The power budget alone is something no one is contemplating. It is very hard to find a discussion about the growth and development of AI that doesn't discuss the issues around power budget. https://www.datacenterknowledge.com/energy-power-supply/white-house-backs-nuclear-energy-for-data-centers https://www.datacenterknowledge.com/energy-power-supply/whit... https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2025/01/14/executive-order-on-advancing-united-states-leadership-in-artificial-intelligence-infrastructure/ https://bidenwhitehouse.archives.gov/briefing-room/president... In building domestic AI infrastructure, our Nation will also advance its leadership in the clean energy technologies needed to power the future economy, including geothermal, solar, wind, and nuclear energy; foster a vibrant, competitive, and open technology ecosystem in the United States, in which small companies can compete alongside large ones; maintain low consumer electricity prices; and help ensure that the development of AI infrastructure benefits the workers building it and communities near it.