4 ms·
> which I strongly consider a waste of money Do you consider all research on AI ethics and bias to be a waste of money? The EA folks are doing some of the best
by zozbot234 5y ago
> which I strongly consider a waste of money
Do you consider all research on AI ethics and bias to be a waste of money? The EA folks are doing some of the best work in that field, and have been focusing on it for quite a while. People used to consider biosecurity and pandemic preparedness a waste of money too, but hopefully we know better.
- handoflixue 5y ago> pandemic preparedness There's a big difference between a threat that has existed for all of human history (pandemics), and a completely novel threat model that might exist in the future (AI)
- probably_wrong 5y agoNo, I do think research on AI ethics is important and necessary. But I also think there's a time and a place, and "third most pressing issue for humanity" is not it. Biased AI algorithms are a problem for the 10% of countries where AI is part of their daily decision process. For the other 90%, "I don't have enough nutrients for my brain to develop" and "I'm severely disabled due to a preventable but unprofitable illness" are much more pressing issues. I support basic research, even in areas whose economic benefit may not be clear. But if someone asks "how can I help humanity the most?", I consider "AI research" to be a really bad answer, to the point of being almost a lie.
- nearbuy 5y agoTheir concern isn't biased AI algorithms. Their concern (well, one of their main concerns) is that a super-intelligent AI could wipe out humanity sometime in the next 100 years. They have arguments that this could happen even if the AI wasn't malicious. I'm a bit skeptical too (and I haven't looked into that much), but it's not obviously stupid. They'd point out that even if there's just a 1% chance of humans being wiped out in the not-so-distant future, that's a big deal (and a large expected value for number of deaths) and we should work on reducing those odds. A lot of this rests on the assumption that super-intelligence is really powerful. Like, take-over-the-world type of powerful.
- probably_wrong 5y agoThat's what I had in mind with my "tiny probability, infinite timescale" multiplier, and also why I said "waste of money". The comment I replied to had a more nuanced point about AI research, which I think merits a more nuanced approach. Having said that, I repeat what I said at some point: once they show that they can stop the dumbest DDOS, then and only then I'll listen to what they have to say about a super-intelligent AI. If they can't do even that, then I don't know why I would listen to anything else they have to say.
- nearbuy 5y agoI'm not sure if you're referring to a DDOS attack on one of their charities. I hadn't heard of that. Cloudflare prevents DDOS attacks. Why would effective altruists work on DDOS attacks?
- probably_wrong 5y agoNo, what I mean is: some effective altruists invest their time and money in stopping a possible future AI from slaving humanity. So, my challenge to them is: if you think that you can stop a super-intelligent AI from taking over, show me that you can stop the dumbest possible malicious intelligence that we know of, which right now would be a DDOS. And the incentives to develop either are pretty much the same, too. If they can't, and my guess is that they can't, then I don't see why I should believe that they can stop anything bigger.
- nearbuy 5y agoPeople stop hundreds of DDOS attacks daily. It's weird to demand AI safety researchers should stop working on AI safety and prove they can mitigate DDOS attacks. The two are nothing alike. A DDOS attack isn't an intelligence. DDOS protection services work largely by having more resources and infrastructure than the attackers. Anyone can do that with enough money. They also aren't researching how to fight malicious AIs. They'd be researching how to program safe AIs. Largely the stuff discussed here: https://en.wikipedia.org/wiki/AI_control_problem https://en.wikipedia.org/wiki/AI_control_problem