I agree that resource allocation is hard, but we're talking unknown unknowns here. There's precedent here that's being extrapolated: approximately no one expect

I agree that resource allocation is hard, but we're talking unknown unknowns here. There's precedent here that's being extrapolated: approximately no one expected ChatGPT ten years ago. We don't know whether there are stepwise improvements at any point in the future, so it's extremely hard to estimate the risk. Estimating it as "irrelevant" might end up just as accurate as predicting in 2000 that computers could not reach chatgpt levels of language mastery. It doesn't require an assumption, just allowing the possibility that a similar breakthrough in computing power and techniques might happen. In comparison, pretty much everyone (?) agrees about "abuses by the companies building those things", so there's no danger of that getting left neglected.