4 ms·
It wouldn’t shock me if multimodal LLMs were good at GeoGuesser [0], but if we’re being picky, it takes more than a few examples to demonstrate a game is “solve
by actuallyalys 1y ago
It wouldn’t shock me if multimodal LLMs were good at GeoGuesser [0], but if we’re being picky, it takes more than a few examples to demonstrate a game is “solved.” I also wonder what kind of data leakage might have been at play, like other people have suggested.
To be clear, my point is not that this is unimpressive, just that this doesn’t demonstrate much. (Edit: I should have said, it doesn’t demonstrate what the title claims.)
[0] they were very likely trained on a large number of photos that had their location, and they have the ability to isolate features. Combinined with their ability to interpret instructions and just, well, guess, that seems like you have enough for the game.
- echelon 1y agoI was thinking it was using IP geolocation, but after experimenting, I think it's just generally informed. Here are a few results from GPT 4.5: https://imgur.com/a/lGTipnn https://imgur.com/a/lGTipnn
- Kolya 1y agoThe examples are cherry-picked. I took a photo outside my office window in a built-up area, o3 thought for 5m 7s (!), and it got the location wrong by 40km. Doesn't look solved to me.
- sadeshmukh 1y ago40 km is imo pretty impressive, but the 5 minute is really a killer. No use in real time applications
- antonvs 1y agoFor real time applications, GPS seems like it'd be much more useful.
- bpodgursky 1y agoThe military/infosec uses of this are not real time. You can wait 5 minutes for a drone strike.
- tempest_ 1y agoYeah but you also cant be off by 40km with your drone strike.
- dredmorbius 1y agoA 40km radius circle is far smaller than a 1000 km radius circle. Once the guesser's made its attempt, it's more straightforward to either refute the guess entirely, or refine within a probable circle of error.
- hhh 1y ago40km accuracy for something arbitrary is a decent starting point. I can normally get within a few meters within a couple of minutes of most images though.
- dogma1138 1y agoNarrowing it down to even a 100km radius for visint analysts to then pinpoint it down is worth its weight in gold already.
- viraptor 1y agoFor military uses, if the us army doesn't have a much more precise, purpose built model, already trained on both private data and whatever they could get from google and others, I'd be extremely surprised. They will not be using chatgpt for serious things like that. (... or at least I'd be sure about that a few months ago - maybe a bit less now)
- bpodgursky 1y agoThere is not a secret super duper powerful military version of cutting edge consumer technologies. AI is catching everyone with their pants down. You have access to the most powerful computer intelligence on earth, the same ones the NSA and CIA have access to. It's a bizarre world.
- abletonlive 1y ago
- paulcole 1y agoThat’s also not GeoGuessr.
- casey2 1y agoWere you in a Google street view car when you took the photo?
- nxobject 1y agoDid you glean anything interesting from the chain of thought about why it took so long?
- cwmoore 1y agoNew title is pretty accurate: "now performs well". Another amenable HN solution.
- xzjis 1y agoI uploaded a picture I took, I don't save GPS coordinates on my pictures, but the first thing ChatGPT did is to read exif data from it.