5 ms·
Sure, I think that kind of "coordination" is a little more credible than what I thought Eliezer was proposing. Maybe I just didn't read carefully enough. One b
by jeffparsons 3y ago
Sure, I think that kind of "coordination" is a little more credible than what I thought Eliezer was proposing. Maybe I just didn't read carefully enough.
One big difference here, however, is that the barrier to entry is lower. You can start doing meaningful AI R&D on existing hardware with _one_ clever person. The same was never true for nuclear weapons, so the pool of even potential players was pretty shallow for a long time, and therefore easier to control.
- YetAnotherNick 3y ago> You can start doing meaningful AI R&D on existing hardware with _one_ clever person. With the current hardware, yes. But then again countries could highly restrict all decently powerful hardware and backdoor them, and you need permission from government to run matrix multiplication above few teraflops. Trying to mess with backdoor is a war crime. A weak form of hardware restriction even happens now that Nvidia couldn't export to many countries.
- upupupandaway 3y agoAnd yet: https://www.scmp.com/news/china/science/article/3239998/chinese-scientists-create-chip-can-perform-ai-task-3000-times-faster-nvidias-a100-study https://www.scmp.com/news/china/science/article/3239998/chin...
- johnthewise 3y agoyeah, he proposed bombing rogue data centers by enforcing countries to be a viable option. he proposes this so we have a chance of solving alignment first, if that's even possible, not eliminating this risk once and for all. In the limit, if alignment is not solved, we are probably doomed.
- csomar 3y agoI think in a few years you'll only be able to run signed software. And maybe any code you write will be communicate to some government entity somewhere to check for terrorism-impact? Well, the future is going to be very fun.
- ta1243 3y ago> I think in a few years you'll only be able to run signed software Frank Martucci will sort you out with an illegal debugger. Sure he'll go to jail for it when he's caught, but plenty of people risk that now for less.
- TeMPOraL 3y ago> Maybe I just didn't read carefully enough. It's this. This kind of coordination is exactly what he's been proposing ever since the current AI safety discussion started last year. However, he isn't high-profile enough to be reported on frequently, so people only remember and quote the "bomb data centres" example he used to highlight what that kind of coordination means in real terms.
- jeffparsons 3y agoAh, okay. Thanks. The world makes a little more sense again!