6 ms·
This is really a "damned if you do, damned if you don't" kind of situation. They can either use Tencent's Safe Browsing API as a drop-in replacement for Google
by yorwba 7y ago
This is really a "damned if you do, damned if you don't" kind of situation.
They can either use Tencent's Safe Browsing API as a drop-in replacement for Google's API, relying on k-anonymity to leak as little information as possible. That leaves them open to accusations that they allow Tencent (or, for that matter, Google) to track the browsing history of Safari users.
Or they can essentially turn off Safe Browsing in China. (Google's API is collateral damage of the Great Firewall.) That leaves their users unprotected against all kinds of malware and scams.
I think they made the right call here by protecting users against the most common threat (most people are not dissidents), while giving advanced users with a different threat model the opportunity to opt out.
- matthewdgreen 7y agoAlternatively, they could purchase the data from Tencent or another company, and operate their own version of the service. That may even be what they’re doing —- but we don’t know, since they launched the service with no details or publicity.
- pmoriarty 7y agoYet another approach is to send the entire list of all malware URLs to each client and let the client do all the processing on their end. This way no data (hashed, anonymized, truncated, or otherwise) would need to be sent to Tencent, Apple, or Google, or anyone else.
- deogeo 7y agoWhy is this getting downvoted? I'm also interested in why this approach isn't taken.
- jhgg 7y agoChrome does something like this, you can learn more about it here: https://codereview.chromium.org/6286072/ https://codereview.chromium.org/6286072/
- mokus 7y agoA couple possibilities I can think of: * the list may be prohibitively large * it exposes to the bad actors exactly which of their scams is detected, so they can simply refine their methods until their sites don’t make “the list”
- Gaelan 7y agoWouldn’t it be pretty easy for the bad actors to check the database anyway? I can’t imagine they would need to query often enough to hit any rate limits.
- cryptonector 7y agoBloom filters take care of the first. There will always be an arms race between attack and defense, so I'm not concerned about the second issue.
- yorwba 7y agoBloom filters can give false positives, and to eliminate them, you'd need to send "data (hashed, anonymized, truncated, or otherwise)" to some entity that has the full list. That's exactly how Google's Safe Browsing API works.
- deogeo 7y agoCan't the bad actors already check each of their sites individually by pretending to be a normal user?
- souterrain 7y agoBad actors can also occasionally poll the safebrowsing API.
- pmoriarty 7y agoExactly how large is it? OS vendors already make a habit of regularly sending gigantic OS updates. I'd have a hard time believing that a compressed list of malware URLs would be noticeably bigger, by comparison. Also, once the list is sent the first time (or just included with the OS so it'd be already present on your device when you bought it), they could just send the deltas as the list changed, and those deltas (especially once compressed) should be relatively small even compared to the original (probably not that large) list.
- cryptonector 7y agoDownvoters who think that might be too much data don't know about Bloom filters.
- morelisp 7y agoPeople who think they know about Bloom filters should consider what attack vectors a false positive with such would allow. (The end result of the thought experiment will be basically what Google does now.)
- robocat 7y agoBloom filters are likely useless in this situation - following facts for phishing only: 1. Phishing sites have a lifecycle of about 15 hours. 2. Most malicious links are hidden within benign domains. 3. About 400,000 phishing sites are created each month. From: https://www.itgovernance.co.uk/blog/4-eye-opening-facts-about-phishing https://www.itgovernance.co.uk/blog/4-eye-opening-facts-abou... I haven't run the numbers, but I am guessing that a clientside solution would have a lot of bandwidth sucking and avoiding false positives is very important. Also with a clientside solution, how are new phishing URLs detected? PS: perhaps try to assume HNers know what a Bloom filter is (I've seen them come up lots of times in comments).
- pmoriarty 7y ago400,000 sounds like a lot, but I wonder how many new URLs Tencent adds to its database each month. I expect they don't add every phishing URL but some small subset of them (possibly even a very small subset.. we'll proably never know). But let's say it is 400,000. I took the URL you linked and made a file of 400,000 copies of it. The file size was 28 MB. I didn't bother compressing that particular file since the URL is the same in each instance, but I expect a file full of actual phishing URLs would probably compress pretty well, so it would probably be significantly less than 28 MB. Considering that OS vendors regularly ship multi-gigabyte size updates, having to download less than 28 MB extra every month shouldn't even be noticeable. If updates needed to be done more frequently, the client could subscribe to get regular updates as they become available.
- lostlogin 7y agoLocal handling seems more Appley too.
- leoh 7y agoRunning their own service would be most ideal. They are definitely not. https://github.com/Igalia/webkit/blob/9777baa3db09cad7ed5b2ca8ddf5188e7a841aa8/Source/WebKit/UIProcess/Cocoa/SafeBrowsingWarningCocoa.mm#L39 https://github.com/Igalia/webkit/blob/9777baa3db09cad7ed5b2c....
- rsync 7y ago"Or they can essentially turn off Safe Browsing in China." The OP as well as the associated blog post[1] as well as the Apple-provided fine-print language do not make it clear to me that this "feature" is exclusively enabled for Chinese users (or, perhaps Chinese IPs). Could someone point to a source that confirms a US person, in the US, with a US-purchased iphone, would not have their browsing history transformed and sent away for analysis to tencent ? [1] https://blog.cryptographyengineering.com/2019/10/13/dear-apple-safe-browsing-might-not-be-that-safe/ https://blog.cryptographyengineering.com/2019/10/13/dear-app...
- kevinday 7y agoIf this source is to be believed, it's either going to Google or Tencent, but never both: https://twitter.com/eromang/status/1183422784082530304/photo/1 https://twitter.com/eromang/status/1183422784082530304/photo... You can try yourself by going to one of the IOS Safe Browsing test pages on your phone, and when the warning pops up click "Show Details". It'll either say Google or Tencent on the warning message, which should let you know which one got chosen for you. https://testsafebrowsing.appspot.com https://testsafebrowsing.appspot.com I just tried it, and it says Google for me in the US.
- jstsch 7y agoGreat. I disabled safe browsing probably back when it first appeared on my iPhone 3G or 4 and this test confirms I’m still not sending urls to anyone whilst surfing on my iPhone 11. Nice job preserving these settings over countless device upgrades.
- mrgalaxy 7y agoFor anyone else wanting to disable it (or at least learn more about it), the feature is labeled in iOS settings under Safari > Fraudlent Website Warning.
- saagarjha 7y agoInterestingly, none of those links triggered a warning for me on my Mac…
- austinkhale 7y agoI believe an argument could have been made that it was the right call if they had publicized it. Seeing as how it was implemented in the background, I am less inclined to give them the benefit of the doubt.
- wolfgke 7y ago> This is really a "damned if you do, damned if you don't" kind of situation. Why? Simply, when setting up the device/browser, let the user choose what safe browsing API the browser shall use (both, one of them, or none). Letting the user make a conscious choice is the best way to handle "damned if you do, damned if you don't" kind of situation. To make the choice as conscious as possible for the user, provide additional material that explains the advantages and disadvantages of each option for the user so that the user is well-informed before he/she makes his/her choice.
- Aperocky 7y agoThat’s entirely against the entirety of Apples modus operandi. It’s always make the user have as little choice as possible and assume that users are idiots. The only exception they made is to developer with cli abilities, and even that they have began to restrict
- oarsinsync 7y ago> assume that the users are idiots Microsoft didn’t make this assumption. Apple did. My entire extended family are now all Apple users. My tech support calls per year can now be counted on one hand. In my extended family, the users are idiots, and thanks to Apple, I’m poorer financially but significantly richer in free time.
- ddtaylor 7y agoDo you think a decentralized database of unsafe URLs could exist?