6 ms·
Artist matches influencer photos with surveillance footage
- irrational 4y ago> while others have criticized what they see as a flippant use of potentially harmful technology: showing how easy it is to access livestream footage and facial-recognition software. Many of these critics encouraged the artist never to make the A.I. he developed public. Security through obscurity? If this artist can create this AI on his own, then many programmers can create it, even if the artist doesn’t make his code public. I feel like many non programmers don’t understand how easy some of this stuff is to replicate once they’ve seen some else build something.
- icegreentea2 4y agoSomething to remember is that "critics" generally just means "random people replying on twitter sampled by the article writing to create a narrative". It's not even a good sampling of what "many non-programmers" think - especially since the single linked critic claims to be a Software Engineer.
- gonzo41 4y agoWas there really the need for AI here? Geo locate the photo shoot, timestamp it and search for a camera that matches? And then it looks like some simple object classifier boxes from open cv to jazz up the images? I think the bigger issue, one that is valuable is the discussion about privacy in public space. Or a better way to put it, you have no privacy at all in public spaces.
- nfgrep 4y agoHmm, yea privacy in public is an interesting thought. I don’t think its ridiculous to say you should have _some_ privacy, even in a public space. It feels like the expectation is that you can be physically seen, but beyond that I don’t see how someone loses all facets of privacy, unless you’re assuming a surveillance-state.
- arecurrence 4y agoThis adds less than you'd think since people are already tracked by their cellular location. Some off-shoot use cases for this are determining where someone travels and when along with who they interact with by looking at adjacent cellular signals. You can quickly solve where they would be expected to go in their daily life, what route they'll take to get there, who they will interact with along the way, and when they will be doing it. Combine this with their credit card purchase history and you can also work out what they're going to buy and how long it will take them to eat it.
- kortilla 4y agoI (along with many others who are privacy conscious or are just tech luddites) do not carry my cell phone all of the time.
- arecurrence 4y agoAlbeit noisier, utilizing facial recognition for the same purpose has been in use for a number of years now. They're both identification mechanisms but tracking IMSIs and Mac Addresses gives both better recall and precision than a network of cameras.
- gfaster 4y agoFor the longest time in urban public spaces, there was a sort of privacy by means of the anonymity processed. You knew that you would never see any of the people around you. That's definitely completely gone now.
- actually_a_dog 4y agoYou do still legally have an expectation of privacy if you’re having a conversation and at least trying to ensure it’s somewhat confidential.
- oblak 4y agoHow do you geolocate a photo shoot and search for a camera that matches? I really don't know what you meant. Assuming you're not talking about phone metadata, of course.
- GenerocUsername 4y agoIt's phone geo data. Not sure if Instagram makes the exif data available
- Tostino 4y agoNo, exif data is wiped from photos by any of the large social media companies and public photo hosts and has been like that for years. Edited to add comma.
- Chazprime 4y agoLast I heard, Instagram strips EXIF data on upload.
- Dma54rhs 4y agoInstagram strips it but people themselves add the location on their own, that you can maybe access through api or at least minimum by scraping.
- glenneroo 4y agoOtherwise sites like this wouldn't exist: https://iknowwhereyourcatlives.com/ https://iknowwhereyourcatlives.com/ (taken from yesterday's posting of OPsec tools: https://news.ycombinator.com/item?id=32951406 https://news.ycombinator.com/item?id=32951406)
- clarle 4y agoYeah, there's no need for "AI" software on this project. From the images, it looks like a straight out-of-the-box use of YOLO v7 or something to make it seem more fancy, but this could be easily be done manually without any machine learning at all (or code for that matter).
- 2OEH8eoCRo0 4y ago> you have no privacy at all in public spaces. Have we ever?
- alistairSH 4y agoNope. Only through obscurity - it used to be difficult/expensive to track somebody’s daily movements. Now it’s relatively trivial to do so.
- 2OEH8eoCRo0 4y agoThis is where I have trouble. It obviously feels wrong to do at scale in an automated way but the only difference is that it got easier.
- alistairSH 4y agoYeah. I feel the same way. And I realize I facilitate it with my phone and other devices. But still, feels creepy at best and dangerous at worst.
- cj 4y agoTo varying degrees, depending on your definition of privacy. For example, it used to be possible to go to a public park with a < 5% chance of being in the background of some random photograph taken by a stranger (or 0% depending on how far we go back in history). Now in many places you can barely walk 1 block without being in the background of someone's iPhone selfie or captured on someone's Ring camera.
- ikurei 4y agoYou don't know when the image was taken, you need to go through the footage until you find the influencer. May be this wouldn't be that hard to do manually, but making it with an AI shows that it can be don at scale; whether the author here did it or fake I don't know, but the message wouldn't be the same without the AI part.
- davikr 4y ago> Many of these critics encouraged the artist never to make the A.I. he developed public. We'll have to wait until OpenAI ethically releases an alternative to "geolocate criminals", as usual. :-)
- lo_zamoyski 4y agoExactly. This is not technically remarkable given what's currently possible. I would actually be surprised is some variation of this isn't already used by law enforcement or security companies. This looks like something a college student might be able to make with something like OpenCV (scaling aside).
- mistrial9 4y agoyeah - colleague here is outsourcing this kind of engineering for security Fortune 500 clients right now, and has been for 2+ years. There is big business going on right now building and shipping exactly this, as high end security camera installs, as far as I can tell. Its not new at all
- prpl 4y agothis is just a time based version of photosynth
- MichaelCollins 4y ago> If this artist can create this AI on his own, then many programmers can create it Yes, the software can't be controlled, the knowledge and skill needed to make it is widespread. But what about the hardware? Production of suitable hardware is very centralized. As more people get burned and shaken by these new systems, I fear we may eventually reach a critical mass where most of the population is eager to restrict availability of new hardware to 'trusted' organizations; corporations and governments.
- PartiallyTyped 4y agoI don't think that hardware control is the solution here as there are no definitive bounds that can limit what is possible since the answer is often just "let it execute in more time", or "run it distributed over a network of other devices".
- rahimnathwani 4y agoDiscussed extensively 12 days ago: https://news.ycombinator.com/item?id=32808808 https://news.ycombinator.com/item?id=32808808
- caxco93 4y agoI was wondering... given that this was indeed discussed extensively before (the original write up shared) is this Smithsonian post even supposed to be shared? I would have guessed it would simply be ignored.
- andai 4y agoI think a different article doesn't count as a dupe, as they often have new information.
- boomboomsubban 4y agoDupes have more to do with how close they are to each other. The same article posted months apart isn't a dupe, different articles on the same subject posted hours apart is a dupe.
- gus_massa 4y agoIt's not automatic, but sometimes the mods decide manually to mark it as a dupe when the new one has no additional information and the other had a big discussion.
- dang 4y agoIf it's the same basic story, we treat it as a dupe. We might not mark it explicitly with the [dupe] marker though.
- adhesive_wombat 4y ago> The project was originally up on YouTube, but EarthCam filed a copyright claim, and the piece has since been taken down. They just need Google to close their account suddenly and irreversibly and they can get the spooky dystopian techno-panopticon trifecta.
- seydor 4y agoCan we please stop using "controversial" in place of "important"
- ARandomerDude 4y ago"Important" means something important that I like. "Controversial" means something important that I don't like. Writing "controversial" makes the reader think something is bad while helping the author avoid the chore of giving any actual reasons for their opinion.
- juunpp 4y agohttps://www.dictionary.com/browse/controversy https://www.dictionary.com/browse/controversy
- ARandomerDude 4y agoYes, I speak English. The point is not how "controversy" should be used, it's about how "controversy" is commonly abused for rhetorical purposes.
- deleted 4y ago[deleted]
- ncr100 4y agoWhy ask permission to change society? What good does that do, appealing to indirect action? Is it a polite way to both state needs and expectations, plus a way to indirectly change, plus a way to open a topic for discussion?
- O__________O 4y agoUnable to find a link, but at one point there was a Russian social media app that would let you take a photo of a random person and it would try to match it to a known social media profile. Someone used the feature to take pictures of people in public looking especially depressed then when possible matched it to photos they had shared on social media of them looking overly happy. Believe they had 5-10 examples in the story that covered it.
- itcrowd 4y agoThe app you are referring to is called FindFace https://en.wikipedia.org/wiki/FindFace https://en.wikipedia.org/wiki/FindFace
- O__________O 4y agoYes, thanks, recall FindFace’s logo. Still wasn’t able to find series of sad faces in public juxtaposed with super happy online photos, but this pic gives a sense of how creepy it is: https://twitter.com/mikko/status/1014127790134882304 https://twitter.com/mikko/status/1014127790134882304 Sure there are number of companies scanning social media pics for face recognition, but another well know one is ClearView; one of their investors was bragging they had the app and would scan people to demo it: https://www.clearview.ai/ https://www.clearview.ai/
- itcrowd 4y agoMaybe this is what you are referring to? https://birdinflight.com/ru/vdohnovenie/fotoproect/06042016-face-big-data.html https://birdinflight.com/ru/vdohnovenie/fotoproect/06042016-... (Russian) Linked from https://advox.globalvoices.org/2016/04/07/the-russian-art-of-meta-stalking/ https://advox.globalvoices.org/2016/04/07/the-russian-art-of... Which was itself linked from https://www.theguardian.com/world/2016/apr/14/russian-photographer-yegor-tsvetkov-identifies-strangers-facial-recognition-app https://www.theguardian.com/world/2016/apr/14/russian-photog...
- O__________O 4y ago
- ericmcer 4y agoThis feels less like an AI that can match surveillance footage to social media posts and more like a dude who matched EarthCam footage with posts made at the same time (probably just found posts with #locationTheCameraIsAt) and then added some green boxes on top to make it look high tech. Especially given that he has 4 examples of it working in 2 specific locations. Very reasonable to put those together by hand in a few days.
- roywiggins 4y agoWhich is why it's more of an art project than anything. Which is fine, but it's basically a magic trick.
- ineedasername 4y agoI used to be more disturbed by the idea of young people aspiring to be influencers, and vacuous nature of such a “career”. But then I realized it’s not much different than any celebrity using that status to make $ on sponsorships, especially those completely unrelated to the roots of their celebrity status. I guess that doesn’t exactly make the activity better, but it at least no longer feels like a further degeneration perpetrated by modern social networks. And it is a sort of democratization of the lucrative paid shill activities concentrated among the very few.
- bombcar 4y agoThe problem is people taking advantage of those wanting to be celebrities-which is a problem that has existed for decades.
- Nextgrid 4y agoBack in the day celebrities were relatively few and you could ignore them while most "common" people were genuine. Now that everyone is (or aspires to be) a "celebrity", you can trust no one. Sure, social media was never completely genuine but the fakeness was generally limited to bolstering someone's social status, not promote garbage from for-profit companies.
- ineedasername 4y agoI think at least in this context it’s that you can’t trust random folks recommendations on the internet, or the appearance/lifestyle they present. In everyday irl encounters not too much has changed (again, in the context of paid influencer activity which is mostly relegated to the media— specifically digital social media.) And when it comes to trying to find real opinions about potential purchases etc online, I don’t really use reviews anymore (and never looked for it in influencer world to begin with). These days if I want real opinions on something I search for product $X site:reddit.com and see what comes up. Even then I figure there’s some astroturfing but it’s still more reliable than, say, Amazon reviews.
- stevenalowe 4y agoCelebrities typically did _something else_, like pro sports, movies, Olympics, walking on the moon… but now we know that is unnecessary. Progress? Efficiency? IDK
- deleted 4y ago[deleted]
- dleslie 4y agoThe folks begging the artist not to release their tools are sort of approaching this from the wrong direction. The problem isn't the tools, which given the information in the article can now be reasonably replicated. The problem is access to the input data. They should be clamouring for laws that prevent public recording, or from those recordings being made available to others.
- roywiggins 4y agoIt's not clear that there are any tools. A dedicated person could do it by hand for the six photos presented. And that's assuming they don't have any other context making the time/date location obvious (maybe he picked Instagram posts where the caption said "Look where I was at 3pm yesterday!"- some of those are probably lies, but you just have to find one that isn't) These days, there are people who are extremely good at locating much harder photos in time and space. This one is relatively simple: https://craighays.com/how-an-investigator-can-find-your-location-from-one-photograph/ https://craighays.com/how-an-investigator-can-find-your-loca...
- brk 4y agoThis was almost certainly a manual process by the artist. The state of the art of commonly available surveillance AI products would not add much in terms of making this process faster or more accurate. (source: I work in surveillance AI). IMO this is really more a of a proof of concept or statement on where things COULD go if currently technology trends progress for another decade or so.
- roywiggins 4y agoYeah, it's a kind of sleight-of-hand or a magic trick- who would spend hours scrubbing the Times Square cameras to match up with Instagram posts? An artist making something like this would. Magic tricks often operate in the same way, you have some meticulous preparation that can produce a specific result, one time, under specific conditions. If you obfuscate the preparation and people don't realize how specific the conditions are, then it looks like something more profound happened than really did.
- ALittleLight 4y agoI had an idea for a modern art installation that would look like a big box you could put in a public park or square. Then, cameras around the box take pictures of passersby and do face recognition against mugshots. When a criminal is found a spotlight on the box illuminates the passerby and a speaker announces their crime. I figure if you felt bad for criminals (or were lazy) you could also just make it illuminate and accuse random people. I will never actually do this - but it seems like it is modern art that would be attention grabbing, getting headlines, and make some kind of point.
- lstodd 4y agoSerious men will just burn the box the next night. Now if you just make it shout twitter handles and/or facebook profile names that would be hilarious.
- ALittleLight 4y agoYou could make the box out of concrete and metal. Or, you could just accept that people will burn / destroy it in one night. It's an art installation - the point is provocation and reaction. If people destroy it? Well, I think that would be a satisfying conclusion.
- mustyoshi 4y agoReminds me of surveillance camera man.
- juunpp 4y agoHow did he access camera footage?
- boomboomsubban 4y agohttps://www.earthcam.com/ https://www.earthcam.com/
- atdrummond 4y agohttps://twitter.com/driesdepoorter/status/1569285878089908231 https://twitter.com/driesdepoorter/status/156928587808990823... Original thread by the creator which I submitted over a week ago but got no interest at the time.
- tracerbulletx 4y agoNothing in the post or the videos indicate any facial recognition or any Machine Learning application. Why would he put the simple object detection overlays in the video at all as if that were relevant for anything other than creating the illusion of AI. I imagine he looked up some popular spots with public camera feeds, found posts with those coordinates and then manually matched the video from the image timestamp. The most impressive thing here is the artist realizing the idea of this would be provocative and garner attention.
- pGuitar 4y agoYou don't need AI when you have GPS location, the time the picture was taken and recordings of the surveillance cameras in the area
- roywiggins 4y agoYou don't need GPS location when the photo is obviously of Times Square, either...
- pGuitar 4y agoof course not but that does require some type of image recognition which is a bit harder to automate (but they had GPS data in that case)
- roywiggins 4y agoIt's Instagram, you can just search by pictures conveniently tagged "Times Square," find one, and trawl through a week of the EarthCam feed of Times Square... https://www.instagram.com/explore/tags/timessquare/ https://www.instagram.com/explore/tags/timessquare/
- pGuitar 4y agoWe need to create a bunch of photos with fake tags and fake GPS info to pollute AIs.
- whycombinetor 4y agoIs it surprising to find publicly accessible video of yourself on the Internet after you walked through (or spent 30 minutes photoshooting in) one of the most popular tourist destinations in the world? That's all this "controversy" or "criticism" in the article sounds like to me, is people becoming aware of the existence of earthcam.com.