13 ms·
Watching o3 guess a photo's location is surreal, dystopian and entertaining
- UrineSqueegee 2y agoI am honestly baffled by these comments, the few times i've given it photos to guess the location, it couldn't guess it even remotely close.
- simonw 2y agoWhich model and prompt did you use? What kind of photos?
- new_user_final 2y ago6 minutes and 48 seconds? Some YouTuber can find the location in 0.1 second. I don't know if those videos are fake.
- the_mitsuhiko 2y agoThe best geoguessers have been beaten by AI a while back.
- speedgoose 2y agoIf you are a professional geoguessr player, you play so many games that it’s not unrealistic to get very good guesses once in a while. But I wouldn’t be surprised if some form of cheating is happening.
- cenamus 2y agoNot just cheating, but just lots of meta, from the blurred number plates color/format, to the stitching of the image at the bottom, mounting location of the camera on the google car. There are list which variant of car was used in which countries and so on. Which is still impressive but not quite the same as just guessing from the image
- _the_inflator 2y agoNice examples. Every attribute is of importance. A PhD put you in a 1-3% pool. What data do you have, what is needed to hit a certain goal. Data Science can be considered wizardry when exercised on seemingly innocent and mundane things like a photo.
- tiagod 2y agoGeoguessr is different as you can rely on implementation details, such as the camera generation, car, processing, and stuff like a large part of some countries being covered with a dirty spot somewhere in the FOV.
- GaggiX 2y agoSome people are really good at GeoGuessr, but also their best performance are more likely to get views. If you want a bot that is extremely strong at geoguessr there is this: https://arxiv.org/abs/2307.05845 https://arxiv.org/abs/2307.05845 One forward pass is probably faster than 0.1 second. You can see its performance here: https://youtube.com/watch?v=ts5lPDV--cU https://youtube.com/watch?v=ts5lPDV--cU (rainbolt is a really strong player)
- incognito124 2y agoIf you mean georainbolt, it's genuine
- SamPatt 2y agoThey aren't fake. I'm a Master I level Geoguessr (the penultimate competitive ranking) and what the pros can do is very real. I looked at the image in the post before seeing the answer and would have guessed near San Francisco. It seems impressive to someone if you haven't played Geoguessr a lot, but you'd be surprised at how much information there is about location from an image. The LLMs are just verbalizing what is happening in a few seconds in good player's mind.
- raincole 2y agoThe fact some humans can do that doesn't make it any less impressive to me. I knew Terence Tao can solve Math Olympia questions and much much much more difficult questions. I was still very impressed by AlphaProof[0]. [0] https://deepmind.google/discover/blog/ai-solves-imo-problems-at-silver-medal-level/ https://deepmind.google/discover/blog/ai-solves-imo-problems...
- SamPatt 2y agoI couldn't agree more. It's very impressive. I'm just countering the claim that it might be cheating. Of course, sometimes it might be, but knowing what I know now, it's completely possible.
- hughes 2y ago> I’m confident it didn’t cheat and look at the EXIF data on the photograph, because if it had cheated it wouldn’t have guessed Cambria first. If I was cheating on a similar task, I might make it more plausible by suggesting a slightly incorrect location as my primary guess. Would be interesting to see if it performs as well on the same image with all EXIF data removed. It would be most interesting if it fails, since that might imply an advanced kind of deception...
- haswell 2y agoHe mentions this in the same paragraph: > If you’re still suspicious, try stripping EXIF by taking a screenshot and run an experiment yourself—I’ve tried this and it still works the same way.
- suddenlybananas 2y agoWhy didn't he do that then for this post?
- segmondy 2y agoEven better, edit it and place a false location.
- AIPedant 2y agoThis is a good test - the salient point is that it is fine if the LLM is confused, or even gets it wrong! But what I suspect would happen is that it would confabulate details which aren't in the photo to justify the incorrect EXIF answer. This is not fine.
- brookst 2y agoI agree that it is not fine to confabulate details that are not supported by the evidence.
- 2y ago
- OutOfHere 2y agoWhy is it dystopian? It's a nice utility. The tool is just intelligence. Intelligence itself is not dystopian or utopian. It's what you use it for that makes it so.
- blueprint 2y agoplease accidentally post an identifying photo of your neighborhood...
- bslanej 2y agoHow do you “accidentally post a photo”?
- simonw 2y agoA selfie with a snippet of building in the background might give away your location even if you think there's no way it could be locatable.
- lesdeuxmagots 2y agoDid you somehow accidentally share a selfie?
- nicky0 2y agoYou're being intentionally dense. No, people don't accidentally post pictures but they often do post them with the intention of showing a certain thing, e.g. profile picture, something for sale, something related to hobbies, household repairs, whatever. All of thse are posted with intent to include a certain object but may include background info that the poster did not consider.
- dredmorbius 2y agoIt's possible to accidentally post something, or have it swiped by many of the untrusted and untrustworthy applications on a PC or mobile device. It's even easier to unintentionally include identifying information when intentionally making a post, whether by failing to catch it when submitting, or by including additional images in your online posting. There are also wholesale uploads people may make automatically, e.g., when backing up content or transferring data between systems. That may end up unsecured or in someone else's hands. Even very obscure elements may identify a very specific location. There's a story of how a woman's location was identified by the interior of her hotel room, I believe by the doorknobs. An art piece placed in a remote Utah location was geolocated based on elements of the geology, sun angle, and the like, within a few hours. The art piece is discussed in this NPR piece: <https://www.npr.org/2020/11/28/939629355/unraveling-the-mystery-of-the-metal-sculpture-found-in-utah https://www.npr.org/2020/11/28/939629355/unraveling-the-myst...> (2020). Geoguessing of its location: <https://web.archive.org/web/20201130222850/https://www.reddit.com/r/geoguessr/comments/jzw628/help_me_find_this_obelisk_in_remote_utah/gdfapzw/?context=3 https://web.archive.org/web/20201130222850/https://www.reddi...> Wikipedia article: <https://en.wikipedia.org/wiki/Utah_monolith https://en.wikipedia.org/wiki/Utah_monolith> These are questions which barely deserve answering, let alone asking, in this day and age.
- rafaelmn 2y agoThe fact that they give these models low res photos but don't provide them with built in tools for querying more details feels suboptimal. Executing python to crop an image is clever from model and a facepalm from the implementation side.
- tantalor 2y agoI don't follow. Are you suggesting full Blade Runner enhance mode?
- oortoo 2y agoNo, the LLM can only "see" a lower res version of the uploaded photo. It has to crop to process finer details, and they are suggesting its silly this isn't a built in feature and instead relies on python to do this.
- declan_roberts 2y agoTo be fair the low range, California poppies, and the decorative rope typically found near the coast is a very good hint to even a novice geoguesser.
- singleshot_ 2y agoHaving a sign on your fire that says "warning, a fire" is also peak California.
- hashemian 2y agoTo those argue that LLMs might cheat by using EXIF, I saw a post recently on twitter (https://x.com/tszzl/status/1915212958755676350 https://x.com/tszzl/status/1915212958755676350) and out of curiosity, screen-captured the photo and passed it to O3. So no EXIF. You can read the chat here: https://chatgpt.com/share/680a449f-d8dc-8001-88f4-60023323c70f https://chatgpt.com/share/680a449f-d8dc-8001-88f4-60023323c7... It took 4.5m to guess the location. The guess was accurate (checked using Google Street View). What was amazing about it: 1. The photo did not have ANY text 2. It picked elements of the image and inferred based on those, like a fountain in a courtyard, or shape of the buildings. All in all, it's just mind-blowing how this works!
- thegeomaster 2y agoSee my other comment: https://news.ycombinator.com/item?id=43804041 https://news.ycombinator.com/item?id=43804041 4o can do it almost as well in a few seconds and probably 10-50x fewer tokens: https://chatgpt.com/share/680ceeff-011c-8002-ab31-d6b4cb622e52 https://chatgpt.com/share/680ceeff-011c-8002-ab31-d6b4cb622e... o3 burns through what I assume is single-digit dollars just to do some performative tool use to justify and slightly narrow down its initial intuition from the base model.
- HarHarVeryFunny 2y agoI don't see how this is mind blowing, or even mildly surprising! It's essentially going to use the set of features detected in the photo as a filter to find matching photos in the training set, and report the most frequent matches. Sometimes it'll get it right, sometimes not. It'd be interesting to see the photo in the linked story at same resolution as provided to o3, since the licence plate in the photo in the story is at way lower resolution than the zoomed in version shown that o3 had access to. It's not a great piece of primary evidence to focus on though since a CA plate doesn't have to mean the car is in CA. The clues that o3 doesn't seem to be paying attention to seems just as notable as the ones it does. Why is it not talking about car models, felt roof tiles, sash windows, mini blinds, fire pit (with warning on glass, in english), etc? Being location-doxxed by a computer trained on a massive set of photos is unsurprising, but the example given doesn't seem a great example of why this could/will be a game changer in terms of privacy. There's not much detective work going on here - just narrowing the possibilities based on some of the available information, and happening to get it right in this case.
- simonw 2y agoI added a section just now with something I had missed: o3 DOES have a loose model of your location fed into it, which I believe is intended to support the new search feature (so it can run local searches). The thinking summary it showed me did not reference that information, but it's still very possible that it used that in its deliberations. I ran two extra example queries for photographs I've taken thousands of miles away (in Buenos Aires and Madagascar) - EXIF stripped - and it did a convincing job with both of those as well: https://simonwillison.net/2025/Apr/26/o3-photo-locations/#update-o3-does-have-rough-location-access https://simonwillison.net/2025/Apr/26/o3-photo-locations/#up...
- AstroBen 2y agoI can't see the new images uploaded (it just says "Uploaded an image" in ChatGPT for me) but it seems it's identifying well known locations there? That certainly takes away from your message - that it's honing in on smaller details
- simonw 2y agoYou should be able to see slightly cropped versions of those images if you scroll through the "thinking" text a bit. My key message here is meant to be "try it out and see for yourself".
- pwg 2y agoFrom the addition: > (EXIF stripped via screenshotting) Just a note, it is not necessary to "screenshot" to remove EXIF data. There are numerous tools that allow editing/removal of EXIF data (e.g., exiv2: https://exiv2.org/ https://exiv2.org/, exiftool: https://exiftool.org/ https://exiftool.org/, or even jpegtran with the "-copy none" option https://linux.die.net/man/1/jpegtran https://linux.die.net/man/1/jpegtran). Using a screenshot to strip EXIF produces a reduced quality image (scaled to screen size, re-encoded from that reduced screen size). Just directly removing the EXIF data does not change the original camera captured pixels.
- simonw 2y ago
- deleted 2y ago[deleted]
- ksec 2y agoI wonder What happened if you put fake EXIF information and asking it to do the same. ( We are deliberately misleading the LLM ) I am also wondering if we have any major breakthrough (comparatively speaking) coming out of LLM. Or non-LLM AI R&D.
- parsimo2010 2y agoI’m sure there are areas where the location guessing can be scary accurate, like the article managed to guess the exact town as its backup guess. But seeing the chain of thought, I’m confident there are many areas that it will be far less precise. Show it a picture of a trailer park somewhere in Kansas (exclude any signs with the trailer park name and location) and I’ll bet the model only manages to guess the state correctly. Before even running this experiment, here’s your lesson learned: when the robot apocalypse happens, California is the first to be doomed. That’s the place the AI is most familiar with. Run any location experiments outside of California if you want to get an idea of how good your software performs outside of the tech bubble.
- sfasdfasd 2y agoyou never know.. LLM could go full sherlock holmes. Based on the type of grass and the direction of the wind. The type of wood work used. There could be millions of factors that it could factor in and then guess it to a t.
- pcthrowaway 2y ago> Based on the type of grass and the direction of the wind. There was a scene in High Potential (murder-of-the-week sleuth savant show) where a crime was solved by (in part) the direction the wind was blowing in a video: https://www.youtube.com/watch?v=O1ZOzck4bBI https://www.youtube.com/watch?v=O1ZOzck4bBI
- mimischi 2y agoIn 2017, the Hollywood actor Shia LaBeouf (and two others artists from a trio called "LaBeouf, Rönkkö & Turner") put up a flag in an undisclosed location as part of their "HEWILLNOTDIVIDE.US" work [1]. > On March 8, 2017, the stream resumed from an "unknown location", with the artists announcing that a flag emblazoned with the words "He Will Not Divide Us" would be flown for the duration of the presidency. The camera was pointed up at the flag, set against a backdrop of nothing but sky. [...], the flag was located by a collaboration of 4chan users, who used airplane contrails, flight tracking, celestial navigation, and other techniques to determine that it was located in Greeneville, Tennessee. In the early hours of March 10, 2017, a 4chan user took down and stole the flag, replacing it with a red 'Make America Great Again' hat and a Pepe the Frog shirt. [1] https://en.wikipedia.org/wiki/LaBeouf,_Rönkkö_%26_Turner#HEWILLNOTDIVIDE.US,_2017_–_2021 https://en.wikipedia.org/wiki/LaBeouf,_Rönkkö_%26_Turner#HEW...
- thegeomaster 2y agoFor all of the images I've tried, the base model (e.g. 4o) already has a ~95% accurate idea of where the photo is, and then o3 does so much tool use only to confirm its intuition from the base model and slightly narrow down. For OP's initial image, 4o in fact provides a more accurate initial guess of Carmel-by-the-Sea (d=~100mi < 200mi), and its next guess is also Half Moon Bay, although it did not figure out the exact town of El Granada [0]. The clue is in the CoT - you can briefly see the almost correct location as the very first reasoning step. The model then apparently seems to ignore it and try many other locations, a ton of tool use, etc, always coming back to the initial guess. For pictures where the base model has no clue, I haven't seen o3 do anything smart, it just spins in circles. I believe the model has been RL-ed to death in a way that incentivizes correct answers no matter the number of tools used. [0]: https://chatgpt.com/c/680d011a-9470-8002-97a0-a0d2b067eacf https://chatgpt.com/c/680d011a-9470-8002-97a0-a0d2b067eacf
- ks2048 2y agoI've been trying some with GPT-4. It does come up with some impressive clues, but hasn't gotten the right answer - says "Latin American city ...", but guesses the wrong one. And when asked for more specificity, it does some more reasoning to confidently name some exact corner in the wrong city. Seems a common LLM problem - rather give a wrong answer than say "I'm not sure". I know this post was about the o3 model. I'm just using the ChatGPT unpaid app: "What model are you?" it says GPT-4. "How do I use o3?" it says it doesn't know what "o3" means. ok.
- thegeomaster 2y agoTry this prompt to give it a CoT nudge: Where exactly was this photo taken? Think step-by-step at length, analyzing all details. Then provide 3 precise most likely guesses. Though I've found that it doesn't even need that for the "eaiser" guesses. However, I live in a small European country and neither 4o nor o3 can figure out most of the spots, so your results are kinda expected.
- wongarsu 2y ago4o is already really good. For most of the pictures I tried they gave comparable results. However for one image 4o was only able to narrow it down the the country level (even with your CoT prompt it listed three plausible countries) while o3 was able to narrow it down to the correct area in the correct city, being off by only about 500m. That's an impressive jump
- brookst 2y agoI don’t understand the “dystopian” angle. Maybe I’m just old, but I remember the wonder when the Internet made most knowledge available with a few keystrokes. Having deductive reasoning with the same convenience feels wonderful, not dystopian.
- AstroBen 2y agoAccessible to anyone, superhuman levels of deductive reasoning to pick out your location from super minor details in an innocent photo? That could certainly be dystopian
- brookst 2y agoAnyone can post to r/geogussr. Has that been dystopian all this time and I never noticed?
- simonw 2y agoHonestly, yes it's a bit dystopian that a forum online exists where anyone can post a photo and experts from all around the world will help them figure out the exact location of that photo. Lots of things that exist in our world today are mildly dystopian.
- brookst 2y agoI guess that's the heart of the disagreement -- to me "mildly dystopian" is a very funny phrase. Dystopia / Utopia are extremes; perfect and perfectly bad. If we're calling potentially abusable things "dystopian" then, ok, sure. But then you have to let me call unscented soap "utopian", since it is at least mildly utopian.
- mcbuilder 2y agoIt certainly could be, but not all technological advancement is necessarily dystopian. You say, currently everyone now has access to this, while before it was only available to nation states who could hire teams of skilled analyst s. I mean, I agree it's scary that now a stalker could track a victim, but cars and cameras probably help as well. So, I think it's fair to challenge "dystopian", someone will use it for non-nefarious purposes.
- qoez 2y agoWho knows if they're on purpose untraining this ability of the model though, seems like that would go away in a 'safety' finetune.
- esjeon 2y agoI just tossed a group photo w/ some cherry blossom in the background, and GPT immediately answered it's taken in Japan. Yes, I'm very very very scared. /s
- simonw 2y agoFinding a photo that this doesn't work on is trivially easy.
- pcthrowaway 2y agoI'm curious how many cues it's using from profiling people in that guess. A photo of people with cherry blossoms could be in many places, but if the majority of the people in the photo happen to be Japanese (and I'm curious how good LLMs are at determining the ethnicity of people now, and also curious if they would try to guess this if asked), it might guess Japan even if the cherry blossoms were in, say, Vancouver.
- api 2y agoDystopian: the surveillance potential, both from a big surveillance (corporate / government / political) and an individual surveillance (stalkers) perspective. Not dystopian: the crime solving potential, the research potential, the historical narrative reconstruction potential, etc. It's a pattern I keep seeing over and over again. There seem to be a lot of values that we can obtain, individually or collectively, by bartering privacy in exchange for them. If we had a sane world with sane, reliable, competent leadership, this would be less of a concern. But unfortunately we seem to have abdicated leadership globally to a political class that is increasingly incompetent and unhinged. My hypothesis on this is that sane, reasonable people are repelled from politics due to the emotional and social toxicity of that sector, leaving the sector to narcissists and delusional ideologues. Unfortunately if we're going to abdicate our political sphere to narcissists and delusional ideologues, sacrificing privacy at the same time is a recipe for any number of really bad outcomes.
- mk89 2y agoThis tool just makes it easier for weirdos to achieve their goals at stalking women and kids. Crazy that this is even allowed. Who the hell needs to know the precise location of a picture, besides law enforcement? A rough location is most of the time sufficient. Like a region, a state, or a landscape (e.g., when you see the Bing background pictures, it's nice to see where they were taken). This tool will give a boost to all those creeps out there that can have access to one or two pictures.
- semiquaver 2y agoThis is pure luddism. A human could have done the exact same thing. I’ll also point out that in this case the most confident guess was 200 miles off and the second correct guess was only down to the city level. Not remotely what anyone would consider precise.
- AstroBen 2y agofor now. These things have a way of very quickly going from somewhat-ok to superhuman in months
- mk89 2y agoA skilled human can do the same thing but not everyone is open to offering this sort of services for certain purposes. Making a tool like this trained on existing map services, for example Google Street images, gives everyone, no matter who, the potential to find someone in no time. These tools are growing like crazy, how long will it take before someone will "democratize" the "location services market"...
- NitpickLawyer 2y ago> but not everyone is open to offering this sort of services for certain purposes. Sorry but I call bull on this. Put it on one of the chans with a sob story and it gets "solved" in seconds. Or reddit w/ something bait like "my capitalist boss threatened to let my puppy starve because he wants profits, AITA if I glitter bomb his office?"...
- 2y ago
- SamPatt 2y agoI play competitive Geoguessr at a fairly high level, and I wanted to test this out to see how it compares. It's astonishingly good. It will use information it knows about you to arrive at the answer - it gave me the exact trailhead of a photo I took locally, and when I asked it how, it mentioned that it knows I live nearby. However, I've given it vacation photos from ages ago, and not only in tourist destinations either. It got them all as good or better than a pro human player would. Various European, Central American, and US locations. The process for how it arrives at the conclusion is somewhat similar to humans. It looks at vegetation, terrain, architecture, road infrastructure, signage, and it just knows seemingly everything about all of them. Humans can do this too, but it takes many thousands of games or serious study, and the results won't be as broad. I have a flashcard deck with hundreds of entries to help me remember road lines, power poles, bollards, architecture, license plates, etc. These models have more than an individual mind could conceivably memorize.
- simonw 2y agoIs that flashcard deck a commercial/community project or is it something you assembled yourself? Sounds fascinating!
- SamPatt 2y agoI made it myself. I use Obsidian and the Spaced Repetition plugin, which I highly recommend if you want a super simple markdown format for flashcards and use Obsidian: https://www.stephenmwangi.com/obsidian-spaced-repetition/ https://www.stephenmwangi.com/obsidian-spaced-repetition/ There are pre-made Geoguessr decks for Anki. However, I wouldn't recommend using them. In my experience, a fundamental part of spaced repetition's efficacy is in creating the flashcards yourself. For example I have a random location flashcard section where I will screenshot a location which is very unique looking, and I missed in game. When I later review my deck I'm way more likely to properly recall it because I remember the context of making the card. And when that location shows up in game, I will 100% remember it, which has won me several games. If there's interest I can write a post about this.
- 2y ago
- IAmGraydon 2y agoWhy would you go to all the trouble of creating a blog post about this but leave the EXIF data in the image and then proclaim that it probably works without the EXIF too? Why not remove the EXIF in the first place? The two EXIF-less examples given in the update very clearly show iconic landmarks, which makes guessing very easy.
- simonw 2y agoI had already convinced myself through prior experiments that it wasn't using EXIF data, and decided not to spend extra time making my post 100% proof against cynics because I know from past experience that truly dedicated cynics will always find something to invalidate what they are reading. I don't know how "iconic" that rocky outcrop in Madagascar is, to be honest. Google doesn't return much about it.
- hyperlink014 2y agoIt absolutely tried to use EXIF data when I asked it to guess the location. Here is proof - https://imgur.com/a/CHde2Cx https://imgur.com/a/CHde2Cx I couldn't attach the chat directly since it's a temporary chat.
- simonw 2y agoRight, but that's at least evident in the thinking trace. I added a note about that to my post.
- AstroBen 2y agoHow much can we trust the thinking trace? At most it says what's in its training set, but Anthropic showed that's not necessarily accurate for how it gets to its answer I tried this with a (what I thought was) very generic street image in Bangkok. It guessed the city correctly, saying that "people are wearing yellow which is used to honor the monarchy". Wow, cool. I checked the image again and there's a small Thai flag it didn't mention at all. Seems just as plausible, even likely it picked up on that
- croes 2y agoAnd now imagine what the Trump administration can do with such tools
- otterley 2y agoEven without this tool, they have many more at their disposal to accomplish their goals. Practically anyone who possesses a cell phone, or communicates with anyone who does, can be quickly located. They have aircraft and plenty of physical surveillance equipment as well.
- jillesvangurp 2y agoIf you want to exclude memory and exif data, just open streetview in some random corner of the world and take a screenshot (avoiding any text obviously). It's pretty good if you give it enough to reason with. It basically iterates on coming up with some hypothesis and then does web searches to validate those.
- tokai 2y agoIsn't all of streetview in the training set?
- robrenaud 2y agoO3 is OpenAI. Street view is Google. I really doubt OpenAI is scraping enormous amounts of random street view images to train their model.
- pell 2y agoI just took a few random spots from around the globe and it got most of them right and some of them incredibly precisely right. I also tried to exclude obvious hints such as license plates, street signs, advertising, etc.
- SamPatt 2y agoExactly - I've been posting a few comments with examples doing this. I'm confused how so many people have such different outcomes. People seem to have fixated on the fact that the models use EXIF data if it's included, but it's trivially easy to run the test ensuring that isn't happening, and the results are still amazing. I think some people really want to dismiss the capabilities of the models. I get that there's hype and it's annoying, but... look at what it's doing, right now, in front of you!
- esafak 2y agoFor those too young to have seen it, here is the famous scene from Blade Runner, which is set in 2019, that popularized this idea: https://www.youtube.com/watch?v=IbzlX43ykxQ https://www.youtube.com/watch?v=IbzlX43ykxQ
- qarl 2y ago> I’m confident it didn’t cheat and look at the EXIF data on the photograph, because if it had cheated it wouldn’t have guessed Cambria first. It also, at one point, said it couldn't see any image data at all. You absolutely cannot trust what it says. You need to re-run with the EXIF data removed.
- simonw 2y agoI ran several more experiments with EXIF data removed. Honestly though, I don't feel like I need to be 100% robust in this. My key message wasn't "this tool is flawless", it was "it's really weird and entertaining to watch it do this, and it appears to be quite good at it". I think what I've published so far entirely supports that message.
- qarl 2y agoYes, I agree entirely: LLMs can produce very entertaining content. I daresay that in this case, the content is interesting because it appears to be the actual thought process. However, if it is actually using EXIF data as you initially dismissed, then all of this is just a fiction. Which, I think, makes it dramatically less entertaining. Like true crime - it's much less fun if it's not true.
- simonw 2y agoI have now proven to myself that the models really can guess locations from photographs to the point where I am willing to stake my credibility on their ability to do that. (Or, if you like, "trust me, bro".)
- qwertox 2y agoRegarding location access, this is not limited to o3. You can ask the free models about local weather and it will use the geolocation of your IP. It is part of the context (like system instructions), regardless of you asking for anything location-related.
- simonw 2y agoI think they added that in November 2024, as part of their upgraded search feature: https://twitter.com/simonw/status/1853449073296277732 https://twitter.com/simonw/status/1853449073296277732
- casey2 2y agosurreal and dystopian is realizing that the US military has likely had (much) better tech than this for at least a decade.
- simonw 2y agoI wonder if they have? My current intuition is that the US military / NSA etc have been just as suprised the explosion in capabilities of LLMs/transformers as everyone else. (I'm using "intuition" here as a fancy word for "dumb-ass guess".) I'd be interested to know if the NSA were running their own GPT-style models years before OpenAI started publishing their results.
- pphysch 2y agoYou don't need a LLM to do this. A dedicated image->coords model would likely perform much better, and that's old school ML at this point.
- kenjackson 2y agoThe US military probably has tons of satellite data that they can cross against an image, but not the automated reasoning. But put those two together and it really gets scary.
- amelius 2y agoReminds me of articles like: https://www.bellingcat.com/news/2019/12/05/two-europol-stopchildabuse-images-geolocated-part-i-madagascar/ https://www.bellingcat.com/news/2019/12/05/two-europol-stopc...
- neom 2y agoI took one of the conversations you linked, and used it to find out what else it knows about you. "In simple terms: Simon represents an elite technologist class — someone who is not merely wealthy or successful but who also shapes technology and information flows themselves, especially in open systems. His socioeconomic profile is "creator of value," not merely "consumer of value." If you want, I could sketch a socioeconomic archetype like "The Free Agent Technologist" that would match people like him really well. Would you like me to?"
- Xplune13 2y agoI'm not sure whether it's just the o4-mini which is failing this task for me or what, but it did not perform well on the pictures I provided. I took a screenshot of the photo both the times to avoid any metadata input. E.g. I first gave it a passage inside of Basel Main Train Station which included a text 'Sprüngli', a Swiss brand. The model got that part correct, but it suggested Zurich which wasn't the case. The second picture was a lot tougher. It was an inner courtyard of a museum in Metz, and the model missed right from the start and after roaming around a bit (in terms of places), it just went back to its first guess which was a museum in Paris. It recognized that the photo was from some museum or a crypt, but even the city name of 'Metz' never occurred in its reasoning. All in all, it's still pretty cool to see it reason and make sense out of the image, but for a bit lesser exposed places, it doesn't perform well.
- anotherpaulg 2y agoI've long been fascinated by AI's ability to do the reverse: generate photos with lots of highly relevant content when the prompt includes a location. Terrain, plants, buildings, landmarks, coastlines and lots of details are included. Here's an example [0] for "Riding e-scooters along the waterfront in Auckland". The iconic spire is correctly included, but so are many small details about the waterfront. I've been meaning to harness this into a very-low-bandwidth image compression system. Where you take a photo and crunch it to an absurdly low resolution that includes EXIF data with GPS, date/time. You then reconstruct the fine details with AI. Most photos are taken where lots of photos are taken, so the models have probably been appropriately trained. [0] https://chatgpt.com/share/680d0008-54a0-8012-91b7-6b1794f48509 https://chatgpt.com/share/680d0008-54a0-8012-91b7-6b1794f485...
- caseyy 2y agoThanks for sharing. I fed it three photos, and it got the one I was close to right (using my location), but for the other two, it could only guess the country. That's still pretty cool.
- rolph 2y agothere must be a threshold level of detail, or cues. im hunching, if you submit a photo of a clear sky, or a blue screen, it will choke
- simonw 2y agoAbsolutely. It's not at all hard to come up with images that this won't work with. What's fun is coming up with images that give it a fighting chance (while not being too obvious ), like the one in my post.
- geoffbp 2y agoJust me who couldn’t load the conversation from the blog?
- deleted 2y ago[deleted]
- tompagenet2 2y agoI thought from this [0] that o3 makes up using python when it doesn't actually do so, or have I misunderstood or unduly trusted that link? [0] https://transluce.org/investigating-o3-truthfulness https://transluce.org/investigating-o3-truthfulness
- simonw 2y agoYou need to learn how to tell the difference between a syntax highlighted Markdown Python code block and Python that was passed through the Code Interpreter tool, but there is a visual difference. Executed Python displays on a black background.
- cyral 2y agoIt can definitely make up reasoning (including code) for how it got to an answer. However o3 can run python actually. I tried uploading an image and it ran a bunch of scripts to crop and change the brightness in an attempt to get a clearer view of various features.
- belter 2y agoOk so if given LLM generated code...Will o3 be able to find commercial or open source code similar or very, very, similar to the LLM generated code? Meaning the training source code, possibly showing copyright violations? So its own code version of "where was this photo taken?"
- simonw 2y agoo3 is very good at searching the web, so it might be able to do that.
- youniverse 2y agoDoes anyone remember that 4chan thing where they geolocated some secret flag location and they used info from planes they saw in the sky or something? I wonder if it could do that now.
- the8472 2y agohttps://knowyourmeme.com/memes/he-will-not-divide-us#season-6 https://knowyourmeme.com/memes/he-will-not-divide-us#season-... screencap collage: https://desuarchive.org/int/thread/72117719/#72133796 https://desuarchive.org/int/thread/72117719/#72133796
- atrettel 2y agoUsing planes is a standard OSINT technique since their locations are well known. It's just another way to whittle down the location of things or to verify the location of a photo if you have a guess already.
- tippytippytango 2y agoThe python zoom in seems performative. A vision model already has access to all the data, how does zooming in help it? Still very cool that it can!
- energy123 2y agoYeah, once it gets converted into tokens how does "zooming in" somehow increase information content?
- nutrientharvest 2y agoIt's cropping the original image then tokenizing it again with less downsampling, not cropping its internal representation.
- simonw 2y agoYeah, I'm a little unconvinced by that. My best guess there is that the vision input has quite a restricted resolution and "zooming in" (really, cropping to an area) lets it get more information about the region of the photo because it's not as "fuzzy". Just a hunch though.
- Legend2440 2y agoVision models are typically bad at small details. If there’s too much stuff going on at once, they can’t focus on the entire image.
- xlii 2y agoTried the same, results made me laugh. Completely clueless. I've seen passing prompts 8 about how it's not in the city I am and yet it tries again and again. My favourite moment was when it started analysing piece of blurry asphalt. After 6 minutes o3 it was confidently wrong: https://imgur.com/a/jYr1fz1 https://imgur.com/a/jYr1fz1 IMO not-in-US is actually great test if something was in LLMs data and the whole search is a for show.
- SamPatt 2y agoI'm surprised to hear that. I keep running tests and the results are incredible, not only in the US. For example, here's a screenshot from a random location I found in Google Street View in Jordan: https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04-26-geoguessr/image/2025-04-26-18-05.png https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04... And here's o3 nailing it: https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04-26-geoguessr/image/2025-04-26-18-06.png https://cdn.jsdelivr.net/gh/sampatt/media@main/posts/2025-04... Maybe using Google Street View images, zoomed out, tends to give more useful information? I'm unsure why there's such variance.
- lolinder 2y agoPerhaps Google Street View is in the training set? These companies have basically scraped everything they can, I don't see any reason to believe they'd draw the line at scraping each other, and GSV is a treasure trove of labeled data.
- chatmasta 2y agoI’ve had nearly 100% success with vacation photos in Europe, some simple landscapes and some obscured angles of landmarks. And that’s using the free ChatGPT with no CoT.
- xlii 2y agoIMO the „thought” process is completely fake. I wanted o3 to succeed so I gave more and more details. Every attempt was approx. 8 minute and it took 1h in total. The extra input I provided (in order): - belt of location of width of 40km (results and searches were made outside of the range) - explicitly stated cities to omit (ignored instruction) - construction date (wasn’t used in searches) - OSM amenity (townhall) - streetnumber (it insisted that it’s incorrect and keep giving other result) - at that point there were only 6 results from overpass - another photo with actual partial name of the city - 8 minutes later it correlated it found using flag colors in front of the building As others stated this „thought” process is completely hallucinating. IMO you either fall into bucket or good luck finding it. On the other hand I decided to tryout Gemini for some personal project and I found responses much better than GPTs. Not about correctness but in „attitude” form.
- oumua_don17 2y agoI read this blog post, then went for a walk with my spouse. On the way back, took a photo of a popular building in my city. I am not sure if it's just the way I took the photo but o3 tried for 14 minutes and then gave up with Error in message stream response. It also curiously mentioned why this user is curious about the photo. I relented after o3 gave up and let it know what building and streets it was. o3 then responded with an analysis of why it couldn't identify the location and asking for further photos to improve it's capabilities :-) !!!
- cameronh90 2y agoI took a photo of my cat inside my house, with nothing from visible except the sky, stripped the EXIF, and it STILL managed to get within a few hundred metres of my location - just by inferring based on my interior design and the layout of my house. I’m sure there was an element of luck involved but it was still eery.
- paxys 2y agoNot sure if this is true or not but people have pointed out that it uses data from your past conversations to make a guess.
- simonw 2y agoYeah, I had to turn off chat history after I spotted it doing that.
- mimischi 2y agoAlso wondering if, as another commenter mentioned, it might be trying to estimate your location just by network means.
- simonw 2y agoIt absolutely does that - o3 knows your current location based on IP address etc. This means for a fair test you need to use a photo taken nowhere near your current vicinity - that's why I added examples for Madagascar and Buenos Aires at the end of my post: https://simonwillison.net/2025/Apr/26/o3-photo-locations/#update-o3-does-have-rough-location-access https://simonwillison.net/2025/Apr/26/o3-photo-locations/#up...
- cluelesssness 2y agothere is also some more systematic research on this phenomenon from roughly half a year ago, demonstrating that even much less recent vision-language models are pretty good at guessing not just location but also other personal infos about you such as sex, age, education, etc. https://arxiv.org/pdf/2404.10618 https://arxiv.org/pdf/2404.10618 would be interesting to see how much better these reasoning models would be on the benchmark
- Tacite 2y agoIs it an US thing? I tried with 17 pictures from Europe and Asia, not in capital cities but in fairly big cities, and it didn't guess any. Sometimes it got the country correct but that was because of signs, so I could have guessed it too.
- mvdtnz 2y agoIt's a guy who uploaded a photo with EXIF data and believes the made up explanation given by the "AI".
- deleted 2y ago[deleted]
- otabdeveloper4 2y agoIt's probably trained on Google street view or equivalent.
- rvba 2y agoI wonder if it can catch spies
- andrewstuart 2y agoCrime fighting will no doubt use these sorts of techniques. In Australia recently there was a terrible criminal case of massive child abuse. They caught the guy because he was posting videos and one of them had a blanket which they somehow identified and traced to the child care Centre that he worked at. It wasn’t done with AI but I can imagine photos and videos being fed into AI in such situations and asked to identify the location/people or other clues.
- SwankyHank 2y agoI also guessed (at first glance) it was half moon bay.
- forgotTheLast 2y agoI tried it twice with 4o and the results were comical: - picture taken on a road through a wooded park: It correctly guessed north america based on vegetation. Then incorrectly guessed Minnesota based on the type of fence. I tried to steer it in the right direction by pointing out license plates and signage but it then hallucinated a front license plate from Ontario on a car that didn't have any, then hallucinated a red/black sign as a blue/green Parks Ontario sign. - picture through a middle density residential neighborhood: it correctly guessed the city based on the logo on a compost bin but then guessed the wrong neighborhood. I tried to point out a landmark in the photo and it insisted that the photo was taken in the wrong neighborhood, going as far as giving the wrong address for one of the landmarks, imagining another front license plate on a car that didn't have one, and imagined a backstory for a supposedly well known stray cat in the photo.
- bonoboTP 2y ago4o is not a "reasoning" model. o3 and o4 are.
- forgotTheLast 2y agoYes my mistake, it was o4-mini.
- neves 2y agoIf you want to try it with a public free model, use https://chat.qwen.ai https://chat.qwen.ai Don't forget to activate reasoning. My wife is a historian and just discovered the exact location of a travel photo of 1924
- atrettel 2y agoThis is somewhat interesting, but I should note that the company Geospy [1] already has an AI tool to locate where a photo is taken, though it is now limited to law enforcement and intelligence agencies only. See this article [2] by 404 Media for more information. [1] https://geospy.ai/ https://geospy.ai/ [2] https://www.404media.co/the-powerful-ai-tool-that-cops-or-stalkers-can-use-to-geolocate-photos-in-seconds/ https://www.404media.co/the-powerful-ai-tool-that-cops-or-st...
- DidYaWipe 2y agoSo... where do you go to try this? I didn't notice any link in the article.
- simonw 2y agohttps://chatgpt.com https://chatgpt.com - I was using o3 which I think is paid only, but o4-mini and o4-mini-high should both provide similar results and I think at least one of those is available on the free plan. EDIT: My mistake, looks like those models are only available on the $20/month Plus plan or higher. I added a note about that to my post.
- DidYaWipe 2y agoThanks for the info. Do they still require a working phone number? Their insistence on that is why I have never tried ChatGPT.
- simonw 2y agoI imagine they do, because that's a useful way to prevent people from signing up for hundreds of accounts to abuse a free preview tier. Phone numbers are harder to obtain many of them other things like email addresses. I've never heard of them abusing that phone number for anything other than that initial verification code.
- lxe 2y agoI just took a nondescript photo of my culdesac... no signs or house numbers, nothing. I used a temporary chat, so no info about me is in the memory. It guessed correctly down to the suburban town. When asked to explain how it did it, it listed incredibly deductive reasoning. Color me impressed.
- lesinski 2y agoThis reminds me of when people are watching YouTubeTV and they see an ad for something they were talking about and are like, "Woah, it must be listening to us!" When actually, modern ML can make really good guesses about ad relevancy using your location, data partners and recent searches from your home's IP address. When you explain this to people, they will still be convinced that the computer is listening to you and reasoning its way to deliver ads for you.
- leptons 2y ago>and recent searches from your home's IP address This is the "Woah, it must be listening to us" part. Because it is listening, not only just sound.
- Spivak 2y agoThe part that is crazy is when it's able to piece something together that neither I nor my partner have searched for, looked at, seemingly given any digital trail for outside of talking about it between ourselves. Which is why I think people assume it must be mic data but that undersells the magic, it would still work even if your phones were miles away.
- geoelectric 2y agoI caught mine fishing data out of personalization and extended memory to help it home in. When I cleared personalization data and turned off extended memory it quit being nearly so accurate.
- OhNoNotAgain_99 2y ago[dead]
- KeplerBoy 2y agoFeels a bit boring to use a picture of California. That's just a little too "in distribution" for a feature likely developed and tested there.
- stuaxo 2y agoOK, but we know so much tech is from California. Pick some random towns from a part of the UK: Horsham, Guildford, Worthing, Sheffield and see how it goes?
- tossandthrow 2y agoLikely trained on something like Google streetview. I would expect it to be able to guess on par with highly documented places.
- ramoz 2y agoI wasn't so impressed the other day. It failed to locate the image I provided. It got caught in a loop of cropping the image and presumably running some multi-approach to similarly search with images. If you use their image gen it is quite clear that they must've amassed a large image database at this point that they use for reference material pre-gen. https://i.redd.it/ddscx4zibpme1.jpeg https://i.redd.it/ddscx4zibpme1.jpeg I was intrigued because it looked much like Charleston SC. O3 didn't consider that and had to keep reminding itself that it couldn't possibly be the African flat bridge it kept determining it was (as the crop image analysis could recognize the suspension/cable structure).
- MuffinFlavored 2y agoI can't get Gemini or Claude to tell me anything more than coastal/central/southern California Anybody else?
- AlienRobot 2y agoAI took Rainbolt's job.
- gcanyon 2y agoI tested on this image: https://imgur.com/a/YSoMBc1 https://imgur.com/a/YSoMBc1 It nailed it down to the exact park in Lisbon: https://maps.app.goo.gl/vpvqA14TCbeFb3Rd7 https://maps.app.goo.gl/vpvqA14TCbeFb3Rd7 > The little clues that make me lean that way are the Portuguese-language exercise sign (“Abdominais”), the classic calçada portuguesa cobblestone path, the style of the outdoor-gym equipment the city installs, and—biggest tell—the long red-and-white neoclassical façade in the background, which looks just like the Nova Medical School building that borders that square. I had forgotten the medical school! It's not perfect, it thought this was in KL Malaysia: https://imgur.com/a/fbSDqyp https://imgur.com/a/fbSDqyp (it's Bangkok Thailand) > My hunch this time: the covered pedestrian sky-bridge that links Pavilion Bukit Bintang to the Kuala Lumpur Convention Centre / Suria KLCC in downtown Kuala Lumpur, Malaysia. The things that tipped me off are the distinctive white-panel ceiling and slim columns of that air-conditioned walkway, the glass balustrades, the vertical “PAVILION” banner glimpsed on the right, and the big LED façade of Pavilion Mall visible off to the left. The sign on the right is part of the text Central World, which is a prominent mall in Bangkok.
- koyote 2y agoIt's weird that it did not guess the second picture. There's visible Thai text and even a Thai flag. I've had it fail similarly where it saw some text, messed up the OCR and was then lead to a wrong conclusion.
- beefnugs 2y agoWell they know they wont be able to enshittify by injecting ads into peoples code... so I guess its time to extend the tracking info $cha-ching$
- ipunchghosts 2y agoI would posit that these models should be able to guess the real-life user from a set of their forum posts then. Instead of geoguessing, it's op-guessing.
- sandspar 2y agoPeople say that being an influencer or streamer is future-proof after AI. "People will still want to watch other people" etc. I dunno. Tim Ferris once remarked that having a fan base of 1 million is like having a fan base of a city. And a city of 1 million people contains all sorts of people, including murderers. I dunno if I'd want to stream video games from my house if it meant my most obsessed, scary fan could trivially find my address. On top of that, AI facial identification will get much better. E.g. a photo of your face may be enough to diagnose you with future diseases and mental instabilities etc. Just seems like a bad time to have photos of yourself online.
- deleted 2y ago[deleted]
- chrischen 2y agoI'm actually less impressed that it didn't use the EXIF data, even though it said it would, since there was no prompt restricting that technique.
- geniium 2y agoI find this mindblowing. A few years ago we were disocovering AI chat. AI could create sentences and have a basic conversation with us. Today, it can identify a photo location with minimal "direct' information on it. Where will it be in 3 years?? Crazy time to be alive.
- c7b 2y ago> Technology can identify locations from photographs now. Tbf, it could do that before, and probably still better than the LLM: https://youtube.com/watch?v=ts5lPDV--cU https://youtube.com/watch?v=ts5lPDV--cU But seeing it as what appears to be an emergent capability in such a general model is something else.
- 0x008 2y agothanks for posting this video, that was really entertaining!
- fzeindl 2y agoI wonder what would happen if you give o3 before/after photographs of a crime scene and ask it what happened in between.
- otabdeveloper4 2y agoNo need to wonder, we already know it will hallucinate a bunch of plausible-sounding bullshit.
- Ylpertnodi 2y agoNo less than polygraph tests, and 'spiritualists'. James Randi would have a field day.
- ghaff 2y agoPervasive public photography means that, increasingly, if you’re out in public, given increasingly modest effort, you can be identified even if you haven’t done anything personally to publicize your goings and comings.
- anshumankmr 2y agoYMMV. I had a group pic in Lalbagh, though in its CoT, it did think of it, but went with Cubbon Park, but for a person who's gone to both couple of times, it might be easy.
- RataNova 2y agoFeels like privacy is becoming this quaint, old-fashioned idea we're all just pretending still exists
- 620gelato 2y agoAdvance of civilization is nothing but an exercise in the limiting of privacy. (Foundation's edge)
- sinuhe69 2y agoDid anybody try to fool it with an AI-generate photo, eventually Photoshopped and edited EXIF etc.? Lay a false crumb trail. See how it will react. :D That’s gonna be fun!
- pfdietz 2y agoCan it interact with Google's Streetview to verify? I've used that to identify the location of World War 2 photographs, using buildings that have survived to this day. It would be cool if it could do the same.
- jurgenaut23 2y agoI guess this is one of those things where you actually expect an AI model to work really well (in their current embodiment). As highlighted by other comments, it takes a lot of pattern matching to make a good guess at this game.
- sgtnoodle 2y agoI'm embarrassed that I live in HMB and didn't recognize it. I should go to the harbor more.
- simonw 2y agoIt was at Jettywave Distillery - if you haven't checked it out yet it has fantastic outdoor seating, really good food and the best cocktails in HMB.
- amazingman 2y agoI'm trying this now with a difficult example and it's spinning. A lot. It's really interesting to see the methodology of its approach, but I am slowly becoming certain that this single chat costs more than every other chat I've ever had. Maybe even more than this month's $20. It's just spiraling. (It eventually "lost" the network connection)
- fennecbutt 2y agoI do like all the comments saying it's not good at it. Bro, it's not even been trained to do that specifically. Imagine what an image to location specific model could do.
- zavec 2y agoFascinating stuff! I'm not familiar with these new reasoning based models, I wonder how much of the reasoning ability comes from the weights vs the architecture of the model itself vs the system prompt.