5 ms·
Apple Has Begun Scanning Your Local Image Files Without Consent
- codehitchhiker 4y agoThis is not new. mediaanalysisd and photoanalysisd have been running on your machine forever doing exactly what it says analyzing media and photos for organizing and creating your fun little montages. mediaanalysisd does things like perform visual searches when you search for a contact. It's the thing that made your macbook BSOD while it was idling or sleeping. You can unload the plist of both of them to disable them. This kind of alarmist nonsense makes it hard for people to believe when big companies are actually doing something wrong :[
- etchalon 4y agoBasic research would have shown this person that mediaanalysisd has been apart of macOS for long before Apple's CSAM local-scanning plan. This is essentially a conspiracy theorist post. 1. There is a thing happening I do not know anything about. 2. There is a thing I read about that sounds nefarious to me. 3. Therefor, A is B.
- sneak 4y agoIf I made any false claims in the article, please let me know ASAP so I can correct them. I was very careful to report facts only and let the readers draw their own conclusions about what is happening here.
- codehitchhiker 4y ago> Apple Has Begun Scanning Your Local Image Files Without Consent You consent when you agree to use their software. The information is encrypted and stays on your device. One of many notices over the years is here: https://www.apple.com/ios/photos/pdf/Photos_Tech_Brief_Sept_2019.pdf https://www.apple.com/ios/photos/pdf/Photos_Tech_Brief_Sept_... And, they've been analyzing your local image files for over a decade for numerous OS purposes. > The media erroneously reported this as Apple reversing course. The article you are quoting (whose author you infer has poor reading comprehension) is from December 2022. CSAM was put on pause in 2021. They have announced as of last month it is no longer being developed. You criticize Lily's ability to understand Apple's statements, and yet: > At the beginning of September 2021, Apple said it would pause the rollout of the feature to “collect input and make improvements before releasing these critically important child safety features.” In other words, a launch was still coming. Now the company says that in response to the feedback and guidance it received, the CSAM-detection tool for iCloud photos is dead. Is this a lack of reading comprehension? Or did you just not read it at all? > Today, Apple scanned my local files and those scanning programs attempted to talk to Apple APIs, even though I don’t use iCloud, Apple Photos, or an Apple ID. > This is your first and only warning: Stock macOS now invades your privacy via the Internet when browing [sic] local files, taking actions that no reasonable person would expect to touch the network, with iCloud and all analytics turned off, no Apple apps launched (this happened in the Finder, via spacebar preview), and no Apple ID input. You have been notified of this new reality. You will receive no further warnings on the topic. You are inferring (and I'm using the term infer to be very charitable) Apple is sending data to its servers based on the media it analyzes. It's clear that packets are coming in the form of GET requests (406B/s) not outbound requests (6B/s). IIRC that API endpoint is for searching to process your input before actually searching your local machine to get Siri suggestions and what not. > Integrate this data and remember it: macOS now contains network-based spyware even with all Apple services disabled. It cannot be disabled via controls within the OS: you must used third party network filtering software (or external devices) to prevent it. I'd call their advertising network-based spyware, but this isn't. And you absolutely can disable these features. I trust you will update the article now.
- etchalon 4y agoYou didn't report false claims. You reported a bunch of unrelated claims without any technical research, and then pointed your readers to a conclusion that lacked any technical or journalistic merit. It's shallow alarmism.
- sneak 4y agoAn entire valid critique, but would you be alarmed if your computer suddenly started making network requests when you were browsing private images in a local directory, having previously opted out of all network services/features? At the very least, it's a bug. At worst, it's covert surveillance.
- etchalon 4y agoOr it's an entirely valid necessity of a feature you do not understand, that's being driven by a system setting you also do not understand. The system could be behaving exactly as it should be, but because you failed to do any research before drawing any conclusions, you've decided there are only two explanations when many more could be possible.
- DoctorNick 4y agolittle snitch has the ability to MITM and display the contents of transfers. I'd suggest you use it and amend the post with details.
- oneplane 4y agoNot for urlsessions with pinned keys, especially not on AMFI binaries you can't patch if you're not in development mode.
- DoctorNick 4y agowell, sounds like he has his work cut out for him then.
- oneplane 4y agoIf he can't do something like "strings /System/Library/PrivateFrameworks/MediaAnalysis.framework/Versions/A/mediaanalysisd" I don't think any actual investigation of the binary or traffic is the first step of learning for him to take...
- IMcD23 4y agoI see no evidence in your post that mediaanalysisd reaching out to an Apple server is related to CSAM detection. Have you analyzed the traffic?
- hx833001 4y agoYou know what you did.
- oneplane 4y ago> let the readers draw their own conclusions That's not how this works. A system-level background process is not going to be 'concluded upon' by random readers on the internet. The only thing you should have written is: "a process made a connection, but I don't know what the process is for or what the connection is for, and I do not know how to investigate it". Your readers could then conclude a bunch: - You use little snitch - But you don't really know how noisy an OS can be - Noise seems scary to you - But you don't know why - And you don't know how to find out You could have made your position more credible by doing some extremely basic tests, like checking for strings inside the binary, or finding out what frameworks and libraries it is linked to. That's 2 built-in commands you can run as a normal user, with no arguments or ordering to think about. But if you did that, your position wouldn't be what it is.
- sneak 4y agoI have an entire blog post about how noisy macOS is, with pcaps: https://sneak.berlin/20210202/macos-11.2-network-privacy/ https://sneak.berlin/20210202/macos-11.2-network-privacy/ I'm not interested in projecting credibility, only disseminating facts for analysis.
- oneplane 4y agoWell, that's not what you did, no matter your intentions. > Apple Has Begun Scanning Your Local Image Files Without Consent Begun? Nope, ancient process and system that has been there for many major releases. Consent? Definitely gave consent, both at the macro and the micro level. You can't actually get up and running or use Finder unless you gave that consent, because it's the first thing that you have to do when you boot up for the first time. So both of your key statements are measurably false, and your blog is riddled with fantasies and propositions that don't have the facts to back them up.
- csydas 4y agoI am not to say you made false claims, but I'm not sure that your connection between what com.apple.mediaanalysisd and the com.apple.snoot API call is fully justified or backed by evidence. It is interesting to understand what this call is for and what the mediaanalysisd daemon is actually doing/sending, but just triggering LittleSnitch while browsing local documents I'm not sure is enough to draw a direct connection. Correlation perhaps, but honestly I think before making the claim that Apple is sending specific document information to their servers, it'd be better to get something a bit more concrete. Checking with just activity monitor on the mediaanalysisd process and its network traffic while browsing through pictures, the sent/received data is bytes in size; I'm not in a position to do a proper network capture, but already I question what those few bytes are and if it's really related to my media browsing activities or just background noise. There is a fairly significant amount of received traffic (like close to 200 GiB) compared to the sent traffic (13 GiB), so I'm not quite convinced that this correlates to media scanning. Passing psgrep with mediaanalysisd to lsof shows a lot of fairly normal background processes/daemons like webkit, AppleSupport, the AppStore, etc., so I find myself thinking it's more a general process despite the name, but far more research of actual packet data is needed. The only mistake I think you've made is that I think your conclusion is premature to connect file browsing to this daemon, as it seems to handle a lot of stuff besides the implication that it scans documents or that it's specifically related to CSAM. Basically, more information is needed in my opinion. Edit: Changed "feel" to "think" in 2nd to last text block to correct my own language issue.
- sneak 4y ago> honestly I think before making the claim that Apple is sending specific document information to their servers, it'd be better to get something a bit more concrete. I didn't make that claim, because I have not RE'd mediaanalysisd to know precisely what it's doing. The strings in the binary suggest it does face and animal detection, and processes some sort of "blacklist". As I mentioned, I don't use Photos.app or iCloud so I'm not sure how any of my media would be eligible for analysis. I was literally viewing images in the Finder via spacebar QuickLook (not even in Preview) when it hit the network for the first time. Maybe it's downloading models? Maybe it's sending analytics? Maybe it's sending perceptual hashes? Who knows? I'm hoping that this post causes someone with the time and skills to do an in-depth RE of the binary to take a closer look at precisely what is happening with regards to images that are not eligible for processing in Photos.app or iCloud.
- twiss 4y agoDoes the basic research also reveal what information mediaanalysisd is sending to Apple, since when, and why? If so, could you link to it? I can't find much about it. (Also, just because it's existed for a long time doesn't mean it's behavior hasn't changed.)
- etchalon 4y agoYou can wire up a proxy and watch the traffic if you were so interested. The fact the articles author didn't bother to and report back what they found, means this person didn't even do the bare minimum of technical research before posting an alarmist article. They saw a thing happening they didn't understand and decided to post some nonsense online.
- twiss 4y agoI can't, because I don't have a Mac. I'm interested what Apple is doing because of the wider discussion, though. So if someone else can, I'd be grateful :)
- kstrauser 4y agoThat’s all true, but I don’t see any evidence that it did change. There are any number of background processes that might have changed. There’s not a story unless it appears that one did.
- kcmastrpc 4y agoI have no sympathy for those who might harm, abuse, and exploit children ... how long until this technology falsely identifies CSAM and results in more victimization (either through false accusations, a botched raid, or death of a family pet).
- KyleBerezin 4y agoI never trust any claims that a surveillance tool will only be used to stop child trafficking. It is used as a method for law enforcement to get their foot in the door.
- kypro 4y agoIt falsely identifies CSAM all the time. That's one of the issues. You have to be careful when taking pictures of your kids in the bath on your iPhone for this reason.
- naetius 4y agoNot sure what brought to the conclusion that "medianalysisd running" => CSAM. Article is a bit on the trashy/alarmistic side IMO with no concrete or technical evidence whatsoever.
- cowsup 4y agoI guess if you really want to get technical, they aren’t explicitly drawing that conclusion. They’re simply saying that Apple announced they’d scan files for CSAM, and now Apple is scanning files for “some reason.” Draw your own conclusion. I think sending a one-way encrypted hash of a file, a la PhotoDNA [0], is a fair compromise. But if Apple is outright uploading your entire photo library for “analysis” without an explicit opt-in, that’s a different beast altogether. And if Apple today isn’t using this for surveillance, Apple tomorrow may be. [0] https://www.microsoft.com/en-us/photodna https://www.microsoft.com/en-us/photodna
- vlovich123 4y agoNeither description is accurate of what Apple did. On a local match, they would send alternate (encrypted) hashes. If those matched as well, they’d send a downscaled version of the file for human review if I recall correctly. Not quite the same as PhotoDNA but also not as alarmist as “they’re uploading your entire photo library for analysis”. The vast majority of analysis is offline and only the assets that matched local AND remote would get uploaded.
- laborcontract 4y agomediaanalysisd has been around for far longer than three years.
- codehitchhiker 4y agothat shit was crashing our machines a decade ago
- oneplane 4y agoThere are so many things wrong with this article, but the most relevant thing: the EULA contains plenty of consent you give upon agreeing and so do the features with their own data exchange sheets that you have to act on before using the feature (at least the first time). Besides that, same as posted elsewhere: mediaanalysisd has existed for a pretty long time and doesn't require iCloud, an AppleID or CSAM scanning to exist. Fun fact: the binary in its many revisions still has an embedded plist with a copyright of 2015 in all currently supported OS releases.
- KyleBerezin 4y agoAre you implying that any amount of surveillance is acceptable so long as it is added to the ELUA?
- maxmouchet 4y agoWouldn't it be more likely that medianalysisd (which is present in macOS since many years) does something like object recognition [1] and connects to Apple servers for updating the model or telemetry or something similar? [1] https://eclecticlight.co/2022/03/23/how-visual-look-up-works-in-detail-1-paintings-on-intel-and-m1-macs/ https://eclecticlight.co/2022/03/23/how-visual-look-up-works...
- pimlottc 4y agoThis could also have something to do with the new feature to detect duplicate photos (added in macOS Ventura) [0] 0: https://support.apple.com/guide/photos/remove-duplicates-pht5a3157c1d/mac https://support.apple.com/guide/photos/remove-duplicates-pht...
- PartiallyTyped 4y agoI’d be interested to see whether this is checking more than hashes.
- WirelessGigabit 4y agoHashing can be done locally. I am increasingly weary of my employer providing me with a device that I need to have on me at all times at home and that is doing all of these outbound connections.
- sneak 4y agoIf indeed it does that, then the title is correct: Apple has begun scanning your local image files without consent. I don't think any reasonable person would expect the OS to do this if you don't use the Apple apps to manage or search images, and have opted out of all analytics and such.
- deleted 4y ago[deleted]
- bibinou 4y ago[flagged]
- celtoid 4y agoLittle Snitch was a must have when I used a Mac. Open Snitch for Linux is still being maintained. https://github.com/evilsocket/opensnitch https://github.com/evilsocket/opensnitch
- marcellus23 4y agoSome very cursory googling suggests that `smoot.apple.com` is used for Spotlight. My guess is this is actually the "visual look up" feature recently added to iOS and macOS, where Quick Look and other system apps will perform OCR on images, and will also attempt to recognize animals/plants/landmarks/etc and offer to look them up for you. Taking a look at System Settings, it seems the relevant part of the privacy information for Spotlight is here: > When you use Siri Suggestions, Look Up, Visual Look Up, when you type in Search, Safari search, #images search in Messages, or when you invoke Spotlight, limited information will be sent to Apple to provide up-to-date suggestions. Any information sent to Apple does not identify you, and is associated with a 15-minute random, rotating device-generated identifier. This information may include location, topics of interest (for example, cooking or basketball), your search queries, including visual search queries, contextual information related to your search queries, suggestions you have selected, apps you use, and related device usage data to Apple. This information does not include search results that show files or content on your device. ... > This information is used to process your request and provide more relevant suggestions and search results, and is not linked to your Apple ID, email address, or other data Apple may have from your use of other Apple services. My understanding is that any actual image recognition is done on-device, so the image itself (or any compressed/hashed version of it) is not sent to Apple. At worst, I suppose Apple might receive a list of features identified by the local image recognizer (i.e., "siamese cat", "eiffel tower") I'd be curious if disabling "Siri Suggestions" would disable this. It seems like it should. I think it's reasonable for very privacy-conscious people to be concerned about behavior like this, but it comes off as paranoid when you wildly jump to conclusions without doing even 5 minutes of research.
- sneak 4y ago> I'd be curious if disabling "Siri Suggestions" would disable this. It seems like it should. Siri Suggestions is disabled on the machine in question (and has been, though I just confirmed that it is off) and this still happened. I have manually disabled every Apple network service that I know of (in the OS UI), and have denied all network access (via LS) to a dozen+ OS processes that phone home.
- kornhole 4y ago
- ur-whale 4y agoWelcome to the cloud, we'll do whatever the f*k we want with your data.
- lossolo 4y agoThis submission should be flagged, as there is no evidence to support the claim in the article. The information provided only shows that a system process called "medianalysisd" attempts to open a TCP connection to "api.smooth.apple.com."
- wux 4y agoApple has confirmed to the media that as of December 2022 that they are not pursuing on-device CSAM scanning: https://www.theverge.com/2022/12/9/23500838/apple-csam-plans-dropped-eff-ncmec-cdt-reactions https://www.theverge.com/2022/12/9/23500838/apple-csam-plans... macOS Ventura exposes new object and scene recognition features for images, including background removal in Preview (analogous to "Copy Subject" in Photos but without requiring the use of that app): https://www.tomsguide.com/how-to/how-to-remove-image-backgrounds-in-macos https://www.tomsguide.com/how-to/how-to-remove-image-backgro... You can also use Spotlight search with keywords such as "flower" or "cow" to find images on your local storage that have those subjects; I don't recall if that is new to macOS Ventura or has been possible for several versions of the OS. mediaanalysisd is a daemon which has for years been responsible for, well, media analysis and would perform any network tasks required to support features such as the above when previewing an image. It would not surprise me if not all image recognition tasks are done exclusively locally, although I haven't found documentation of how much exactly is or isn't. It has long been the case for speech recognition, for example, that not all of it could be done offline (although more of it can be on Apple Silicon machines). The only way to opt out of OS-level features that send any data to Apple at all is to opt out of using macOS; even then, as I recall, the Asahi Linux installer has to pull certain bits from Apple servers for copyright reasons.
- nullc 4y agoNo, now they just appear to be sending the same hashes that they'd cryptographically match against a database to some server of their to do with whatever they please (or with they're ordered at gunpoint to do).
- phnofive 4y agoThey have not 'begun' this, it's been happening for a some time, with the (perhaps uninformed) consent of whomever accepted the license.
- lapcat 4y agoA couple of notes: 1) I'm still on macOS 12.6.2 Monterey, with Little Snitch, and mediaanalysisd never makes any network requests (though it does exist and is running). So there may be something new on Ventura. 2) You can see the https request and response headers (but not the decrypted data) using this technique: https://lapcatsoftware.com/articles/logging-https.html https://lapcatsoftware.com/articles/logging-https.html
- throwmeup123 4y ago[flagged]
- naetius 4y agoSide question for the author (@sneak): I've noticed some _pk cookie (Motomo?) being injected while visiting your page and some attempted requests to t.sneak.cloud (and others) but haven't (yet) found a consent notice on your site. What's up?
- sneak 4y agoMy site sends cookie headers to your browser, which can optionally be returned to my server on subsequent requests if you so desire. Your browser will have settings to configure this behavior so that you can set it to whatever you wish. My site still works fine if you do not send any cookie headers whatsoever, so you will have no issues browsing it with cookies disabled or cleared (or not persisted) at your option. I find the Cookie Autodelete browser extension to be extremely useful in this regard.
- antioxidant 4y agoSame thing for me. First time mediaanalysisd has ever connected to the internet. Why? What is it sending?
- puppycodes 4y agoYour right to assume you don't know whats happening behind the scenes in a proprietary software without further investigation. I think the cognitive dissonance is not following that conclusion to its logical end which is: use a non-proprietary software, otherwise you can't know what you dont know and you cant learn what you cant discover, among other tautologies. What little snitch alerts you too isn't even scratching the surface of whats going on behind the scenes on your device. If you would like to get a sense of that check out FSMonitor and just run it in the background for an hour.
- technick 4y agoI wonder if little snitch gets access to _all_ traffic. I remember several osx releases ago there was an issue because osx (big sur) moved to an api interface and it broke little snitch. I assume if apple was dedicated enough they could block some traffic from being seen by little snitch.