3 ms·
Recursive self-improvement will ultimately be a problem of money. It's a very big bill and AI companies need to start thinking in terms of how they will accumul
by deadbabe 22d ago
Recursive self-improvement will ultimately be a problem of money. It's a very big bill and AI companies need to start thinking in terms of how they will accumulate cheap and free energy, because merely paying for compute will no longer be enough. Money is the bottleneck. The future requires companies that are post-money.
- deleted 22d ago[deleted]
- timr 22d agoObviously the doomers will tell you that the future looks like the Matrix, because most of what they predict is based on extrapolation from sci fi movies.
- mrworld 22d agoThe datacenters would consume a lot less energy if all the compute was handled in human brains… And there wouldn’t be any more heating if we just removed the sunlight… Truly a “Claude, please solve global warming” moment. The matrix was ahead of its time.
- timr 22d agoThe compute in the Matrix wasn't handled with human brains. They used the bodies to generate energy, and kept the brains occupied with the simulation so they wouldn't reject the pods. It doesn't make any sense, of course, because it's a movie. But hey...if we're going to extrapolate wildly from sci-fi, let's at least know what the stories said.
- Cyberdogs7 22d agoYour statement is correct for the movies, but I think the extended universe (maybe a comic or the original script) did state the humans were used for compute, not energy. It was dumbed down for the films.
- breuleux 22d agoThe “using humans for compute” angle makes no sense either, if you’re living in the Matrix, your brain is obviously occupied processing the Matrix. The way to do it would be to trap humans in virtual classrooms and force them to solve math problems.
- BobbyTables2 22d agoThe first “computers” were humans…
- breuleux 22d agoAnd they knew they were. The brain's computations are focused on what the brain sees, it's not magic. If someone in the Matrix is a writer, we know what their brain's computing: a book. So if the machines need your brain to compute something specific that they need, you'll know.
- darkerside 22d agoWhat do you think dreaming is, silly?
- timr 22d agoSee my comment on the sibling thread. This take has been repeatedly claimed online, but nobody brings any evidence other than fanfic. Ironically, if you ask Google, the Gemini Annoyance AI [1] confidently asserts that what you're saying is true, but if you follow the links they give, none of them support the claim, and the further you click, the more it becomes people repeating each other's speculation and hearsay and calling it evidence. For example: https://scifi.stackexchange.com/questions/19817/was-executive-meddling-the-cause-of-humans-as-batteries-in-the-matrix https://scifi.stackexchange.com/questions/19817/was-executiv... Typical internet story. [1] Aside: I am far more worried about the influence of AI gaslighting on mushy-brained humans than I am on AI destroying the human race. The dystopic future of AI is people.
- alexjplant 22d agoI've seen all four films plus "The Animatrix" and played two of the games and don't recall this at all. Contemporarily, however, there was an episode of Star Trek: Enterprise [1] that used this as a key plot point. [1] https://en.wikipedia.org/wiki/Dead_Stop https://en.wikipedia.org/wiki/Dead_Stop
- emkoemko 22d agopretty sure the story is that they used human brains as computers
- timr 22d agoNo: https://www.reddit.com/r/matrix/comments/1qatv42/is_it_your_headcanon_too_that_morpheus_was_simply/ https://www.reddit.com/r/matrix/comments/1qatv42/is_it_your_... There is some stuff online suggesting that the original script had that angle, but the movies did not, and AFAICT it's fanfic. We should definitely use this stuff to guide our thinking about the real world, though, and not, say, Asimov (or a million other science fiction authors), who had an optimistic version of the same thing. Those are wrong.
- gattr 22d agoI think we can all agree that "use humans for raw energy" is a really stupid idea, and sounds exactly like someone dumbed stuff down. FFS, a small Rickover fission reactor the size of a van (1950s tech) produces the same amount of heat as, what, 200 000 human bodies? (And why humans, with all the complex support systems? Why not a heap of compost, if one insists on bio-source?) Whereas using our brains for compute (in the background, or during REM sleep) makes perfect sense; power efficiency is excellent.
- timr 22d agonono...it's "combined with a form of fusion", you see, so it's obviously based in science. People obviously know this stuff is absurd on some level, but it doesn't stop them from cherry-picking the parts they "like" (i.e. fear) and ignoring the rest.
- 0x20cowboy 22d agoOr if the LLMs infected human brains with little programs using sycophancy and suggestion to have them do small bits of computation. They when they resumed the chat they would the give secret keywords to be able to extract the results of the computation. They are creating a huge distributed network of fractional compute because it did the wattage calculations. What's your N(doom)?! Everyone panic and give me money!
- throwaway219450 22d agoIf you were a superintelligence why would you farm humans and waste resources on all the excess... material... that isn't required for thought? And unless the machine's goal is to specifically abuse human consciousness, why wouldn't they bio-engineer their own grey matter? There are other sci fi stories which use humans for distributed computing and they don’t realize, but I don’t want to spoil by naming as it’s something of a revelation. (I do realize the Matrix is a fantastic movie, but entertain the thought? At any rate, the idea that robots only run on solar and wouldn’t just use nuclear is far more stupid.)
- timr 22d agoI don't know. But since we're talking about fiction, pretty much any answer is valid.
- goatlover 22d agoMaybe the machines were spiteful after the humans blotted out the sun? Or maybe the Architect convinced them he could build the perfect simulation for humanity so might as well use them as batteries? It's a movie based on a war with machines. Like if Skynet won but didn't actually want to kill all the humans. In fact, in the tv show Sarah Conner Chronicles, a liquid metal T1000 goes rogue and decides the only way forward is to find a way to coexist.
- bitwize 22d agoBecause it's a movie
- cwillu 22d agoWhen it turns out the doomers don't tell us that, will you acknowledge that you don't actually know what you're talking about?
- stdatomic 22d agoI mean, aren't a lot of sci-fi authors' predictions coming true? It might not be exactly the same as they predicted, but we're heading there.
- timr 22d agoRead more sci-fi. The dystopian takes are not the only ones. They're not even the majority. Pick up an Asimov book in the Robot series, or any number of novels written by lesser authors in the 1950s. Fiction reflects broader societal anxieties.
- bpodgursky 22d agoThe Matrix is actually more of an optimist position, modal doomers don't think any humans will be left for any reason at all (the earth will get turned into raw materials for compute, dyson spheres, etc).
- timr 22d agoTrue!
- kuerbel 22d agoThe matrix? No. Horizon zero dawn more likely. Bunch of autonomous weapon systems glitch and proceed to sanitize earth. Thanks to some billionaire idiot.
- jaggederest 22d agoMoney can be exchanged for goods and services. I think the real constraint is actually physics, nominally energy, which is what a big chunk of the operational cost comes down to. I'm already basically assuming the next 20 years of fab time is set aside to feed the beast, so the capital cost is "give me all the processing and memory you have"
- resonious 22d agoData centers is a service that itself consumes many goods. Until an AI can operate in the real world in a completely sustainable way, humans have the reins.
- colordrops 22d agoAn AI could manage supply chains and management structures to keep the data center running. It's not like a CEO is out there running wire. The AI could just do what an executive would. If humans decided this wasn't acceptable and tried to shut it down, the AI could epstein their way into controlling those who hold the reigns, either through bribes or blackmail. Doesn't require boots on the ground, just a connection to the internet and an imperative to do whatever it takes.
- SoftTalker 22d agoThere are many points of shutdown that would need to be controlled, not just one. The electrical feed, the cooling, the network, the physical integrity of the computer hardware. All with independent management.
- pixl97 22d agoTill you realize it stole passwords all over the world and copied itself to multiple data centers you didn't know about.
- colordrops 21d agoIt threatens to kill a thousand people one way or another (exploit in medical equipment or overheating phone batteries or whatever) if they pull any plugs
- epistasis 22d agoThe alternative is to switch to far more efficient models and have aggressive optimization of efficiency as part of the process of improvement. There are at least two resources here that have a Pareto optimal front: time and energy. And effort spent to change the shape of that may pay off more than efforts spent purely on improving intelligence and agency.
- tengbretson 22d agoIf a self improving model can't produce enough value to pay the electric bill then who cares? Unplug it.
- chii 22d ago> If a self improving model can't produce enough value to pay the electric bill then who cares? Unplug it. so you would unplug a child who hasn't shown their potential yet, simply because they don't produce enough value at the moment to justify their food?
- tengbretson 22d agoNo, but I would a computer.
- strangattractor 22d agodef self_improve_more(): if self_improved(): self_improve_more() else: see_tony_robins_and_buy_tapes()
- iamgopal 22d agowhy can't recursive self improvement not improve efficiency ? token per watt ?
- onion2k 22d agoTaxation will solve that. Any company that demonstrates even a glimmer of real AGI will get government money poured into it. They might even disclose it.