5 ms·
Putting aside the obvious about death threats: you seem to think that being thoughtful and well-intentioned is disjoint from making the world a worse place. The
by saagarjha 3y ago
Putting aside the obvious about death threats: you seem to think that being thoughtful and well-intentioned is disjoint from making the world a worse place. There are plenty of very passionate, smart people working in CSAM detection who propose variations of banning E2E every year. We don’t do that because the harm it causes would be incredibly high, even though CSAM is horrible and we should continue to work to stop it from being a thing.
Fraud is very similar. I’ve interacted with another of the proposal’s authors and they came off as smart and reasonable too. The problem, of course, is that if you focus in one area it is easy to become blind to what the other effects of your work can be, and weigh them appropriately. There are lots of things introduced with good intentions that end up going sour because they either don’t work or people with bad intentions abuse it. Or, even more often, people with neutral intentions but misaligned incentives end up making things that suck. Google has done this often in the past and they will continue to do that in the future because they’re a big company with various goals that do not always align with what’s good for society.