4 ms·
To be clear, this is a really serious situation. The current Online Safety Bill wording from https://bills.parliament.uk/publications/49376/documents/2822 http
by Arathorn 4y ago
To be clear, this is a really serious situation.
The current Online Safety Bill wording from https://bills.parliament.uk/publications/49376/documents/2822 https://bills.parliament.uk/publications/49376/documents/282... (https://bills.parliament.uk/bills/3137 https://bills.parliament.uk/bills/3137) is as follows: clause 124(3) declares that OFCOM (the telco industry regulator) can impose "proactive technology" to comply with or remediate illegal content, child safety or fraudulent advertising(!):
(3) A proactive technology requirement may be imposed in a confirmation decision only for the purpose of complying with, or remedying the failure to comply with, any of the duties set out in—
(a) section 9(2) or (3) (illegal content),
(b) section 11(2) or (3) (children’s online safety),
(c) section 23(2) or (3) (illegal content),
(d) section 25(2) or (3) (children’s online safety), or
(e) section 33(1) or 34(1) (fraudulent advertising).
and clause 202(1)(a) then defines "Proactive technology" to mean:
202 “Proactive technology”
(1) In this Act “proactive technology” means—
(a) content moderation technology,
(b) user profiling technology, or
(c) behaviour identification technology,
In other words, the Bill gives the industry regulator the ability to impose a requirement that communication apps implement content moderation technology - which for an end-to-end encrypted system, obviously means the ability to scan and exfiltrate encrypted content to moderators (as how else can you moderate content). As a result, anything that whatever scanning technology deems illegal would have to end up in an unencrypted moderation queue (presumably provided by the app vendor?!), thus completely violating the encryption privacy guarantees. For instance, folks in Ukraine using Signal/Element/etc to discuss being bombed might end up with their messages exfiltrated by the scanning software to a moderation queue because they include the word 'bomb', which is then a sitting target which bad actors would use to gather intelligence and entirely sidestep encryption.
The penalty for not complying is still being determined, but could mean jail time for those building the apps: https://www.telegraph.co.uk/politics/2023/01/16/rishi-sunak-forced-back-online-safety-bill-tory-rebellion/ https://www.telegraph.co.uk/politics/2023/01/16/rishi-sunak-...
This is LITERALLY the online equivalent of putting a CCTV camera in everyone's bedroom, hooking it up to an machine learning classifier to detect 'illegal activity', and then sending unencrypted recordings to a moderation queue run by the CCTV vendor.
It's terrifying, and we have to stop it, before it sets a precedent that the EU follows with ChatControl, or that the US follows (or uses it as an excuse to remove E2EE entirely).
The way to stop it is to yell about it loud on social media, talk go the press, and if you're in the UK, write to your MP (they do actually read these letters).
Signal & others, if you're reading this: we need to coordinate on an open letter to UK Parliament (probably the House of Lords Committee) to present a united front against this; please ping me at matthew[at]matrix.org to sync.
The OSB is alarmingly advanced through the legislative process, and we are running out of time to stop it.
- cnity 4y agoI have a question: what does it mean for the _users_ of messaging applications? If the OSB passes am I still within my rights to PGP encrypt my messages before sending them?
- walterbell 4y agoThat may depend on whether operating systems (including app stores and package managers) are also regulated, e.g. via the EU Cyber-Resilience Act, https://news.ycombinator.com/item?id=34760173 https://news.ycombinator.com/item?id=34760173
- hellojesus 4y agoWorst case you could always roll your own based on proven open source libraries, down to the metal.
- Arathorn 4y agoIn the current wording: yes, you can go encrypt your messages with PGP before sending them. However, the worst-case scenario is that Ofcom would then say to Apple and Google: "Hey, you are communication service providers (thanks to iMessage and Google Messages/Chat/etc). We believe you are failing to adequately block illegal content. Therefore we legally require you to perform content moderation. And given you also provide the operating system for your services, and given you've already demonstrated you are willing to do client-side scanning at the OS layer (https://www.siliconrepublic.com/enterprise/apple-csam-child-safety-sexual-abuse-material-uk-privacy https://www.siliconrepublic.com/enterprise/apple-csam-child-...) clearly we expect you to scan for illegal content in the OS. Therefore, please scan all content for illegal content, otherwise we'll send your UK-based staff to jail. By the way, have you considered putting scanning in the graphics pipeline? Then we can make sure that you do OCR and image-classification on all pixels that users see, to make sure that after users PGP-decrypt their messages we can spot words like 'bomb' or worse, and send evidence through Apple/Google's moderation teams, so they can be able to block the illegal content and uphold their obligations to report CSAM etc to the authorities." To be clear, this is a worst-case scenario, but it's the logical extrapolation of what the OSB allows. (That said, IANAL).