7 ms·
IP Geolocation Is Twenty-Five Years Old
- wara23arish 3y agoVery cool read! I wasn’t working during your time, but I recently have been working on maxmind db datasets. How different was it to what was offered in the past? I used to think this data was sourced from ISPs and could not be deduced from how you mentioned in your post
- sanjayparekh 3y agoThis is a great question. So when I came up with IP location back in 1999, there was nothing for location-based targeting. Any advertising that happened would be because a user shared a location (ZIP code, etc.) and then got cookie'd and that information was brokered between sites. This obviously doesn't work for more secure uses (content control, fraud detection, etc.), so some of these uses were made possible once we launched. The shift to streaming content would never have happened without a secure way to accurately know a user's location. The other part of your question, I think, deserves its own blog post. One of my tenants was to NEVER be reliant on someone else's willingness to give us data or access. So, everything was designed with the idea that we would have to gather first-hand data and knowledge. If an ISP gave us data, that would be great and make things easier. But being beholden to ISPs would mean we would be hosed if the sands shifted. This is why I am still flabbergasted when people build their entire company based on someone else's platform, API, etc., and then are upset when those platforms change their models. If you build the foundation of your company on someone else's land, be prepared to lose the house.
- qingcharles 3y agoI was doing legit music downloads and streams for the major labels in late 1999/early 2000 and I was using some sort of paid IP database to determine which of the 34 countries we covered the user was connecting from, so I could pay the right royalties. Was the market really that small for IP geolocation 25 years ago? I don't remember it being a problem to source the data...
- sanjayparekh 3y agoI think a lot of people are confusing access to some kind of IP location data with access to high(er) accuracy data. Yes, you could scrape whois data to create a IP location database but even country level would be in the mid-80s and then dramatically drop off from there. In the early dot-com boom, that was good enough since there was nothing really better.
- qingcharles 3y agoGot you. I can't remember how accurate the database was. I think as long as you were "in" one of the 34 countries then the app worked fine, even if it had you pegged in the wrong place.
- deleted 3y ago[deleted]
- below43 3y ago"That comment of "crushing us" was infuriating. We decided to go it alone, and the results show this was the right decision." Very satisfying to read!
- sanjayparekh 3y agoIt was very satisfying to live through and now reflect back on. :-)
- hnfong 3y agoIt's extremely {whatever}-centric to assume that IP location in any way implies anything about one's preferred language. There are multi-lingual countries. There are cultural minorities. People travel. (Not to mention VPNs becoming more popular these days.) So I always found it infuriating that web sites would try to guess my language from geoip when my browser already sends Accept-Language headers. They spend resources doing this stuff, think they're doing their users a service, give themselves a pat on the back, and then unnecessarily screws up the UX for a significant portion of the users. I have no idea why companies keep doing this.
- sanjayparekh 3y agoSee my comment about this on another response.
- junto 3y agoFor the last 25 years I’ve hated this invention because it has been continually conflated to make the assumption that my preferred language is based on the country I currently find myself. Every major global tech company has made this mistake and nearly all of them deliberately override my Accept-Language request header and ignore it. Did you know that over 8 million people worldwide are native speakers of Catalan, whilst only 4 million people speak Norwegian? Guess which speakers are continually ignored. When I travel to France, should websites push me to use the website in French, even though I don’t speak it? No. Incorrect understanding of the problem and badly misused over time. I’d vote to have the IP2Location databases killed off and buried for good.
- sanjayparekh 3y agoYou're confusing the tech/innovation with the uses. I agree with you that not respecting, or rather assuming, a user's preferences is a bad UX mistake. That said the tech is also used for content control without which streaming of shows and films would be impossible to contractually happen. It is used to protect your bank account. It is used in a myriad of ways that are much less visible than just picking a language or showing targeted advertising.
- hnfong 3y agoI understand your article was about the tech. But you did mention the motivation of geoip for detecting location for selecting a language, and given that's what people still do these days despite Accept-Language headers being available for most clients, I think it's worth a call out.
- sanjayparekh 3y agoOh, I agree with you. I don't really understand why sites don't use language headers which obviously specify the user's preference. I've never been on the implementation side for sites that were clients - I just explained the tech, showed how they could use it, and then they used it in those ways and many times more. Maybe it was just easy rather than having to use multiple variables? Maybe they don't know about this header (which would be shocking IMO)? But back in 1999/2000 time frame, no site was using the language header which may or may not have existed back then - I honestly don't know when that was introduced into browsers (I was a Netscape Navigator user back in those days). I'll also say that even though I invented IP location technology, I am an avid user of privacy-shielding VPNs. Just because you invent something doesn't mean you don't regret some of the uses of said thing.
- brianhama 3y agoI used your product when building my start-up. Fascinating to hear the back story!
- sanjayparekh 3y agoWhoa! That is awesome. I get chills whenever people tell me they've actually used something I've built. Hoping I get the chance to write more about the stories from my time building Digital Envoy. Congrats on your startup too - I hope it is/was wildly successful!
- incolumitas 3y agoAnd IP geolocation is still very relevant as of today. You can derive an enormous amount of geolocation data by looking at WHOIS data: https://ipapi.is/geolocation.html https://ipapi.is/geolocation.html
- geraldhh 3y agolol k
- ggm 3y agohttps://www.ripe.net/publications/docs/ripe-181/ https://www.ripe.net/publications/docs/ripe-181/ October 1994. which is 28 years ago. Contains the inetnum: object as follows The information in the old inetnum object inetnum: 192.87.45.0 netname: RIPE-NCC descr: RIPE Network Coordination Centre descr: Amsterdam, Netherlands country: NL So.. I hesitate to be snitty, what exactly about IP geolocation did you invent given that by 1994 we already had a formalism to represent IP economy in the records?
- toast0 3y agoI had the same kind of thought, but I think the 'invention' is really figuring out an application of ip geolocation, and a market for that application. IMHO, it wasn't hard to figure out roughly where servers or peers were in the real world based on their IP address and network routes to them, but it was non obvious why someone would want to pay for a service...
- ggm 3y ago"I worked out how to monetize it" is very different to "I invented it"
- sanjayparekh 3y agoTo clarify, yes whois registries have existed since the start of the Internet. However the location provided by those registries does not equate to the users' location. For example, back in the day, IBM (IIRC) ran a worldwide network of dial-ins and all of their IPs were registered back to their headquarters in Schenectady, NY. So yes, we figured out how to monetize it and maybe in the extreme "invented" is a stretch - maybe I should have said "invented a way for it to be accurate to a city level". In case you're wondering, 94% accurate to a city level, worldwide when I was there.
- silisili 3y agoI think this is a much better tagline, personally. It paints a picture of how it went above and beyond what was there already.
- yosito 3y ago25 years old and still constantly misused by tech companies to assume my language preferences while traveling even though my browser explicitly communicates my language and locale preferences. Spotify and Google are particularly notorious offenders.
- kristopolous 3y agoWrote about that 7 years ago over here https://kristopolous.medium.com/stop-guessing-languages-based-on-ip-address-3862464b97c7 https://kristopolous.medium.com/stop-guessing-languages-base...
- Larrikin 3y agoI usually mentally filter any links that I see that are on medium, and actively block them from search results. Old articles like yours can be read to the end, but with a banner blocking a third of the page, and nearly 100% of new articles I've come across in the past year get a nice paywall right at the entire reason I clicked on the article. All the new articles that aren't blocked are worthless content I wish I hadn't clicked on.
- kristopolous 3y agoI should probably just self host all my stuff and stop assuming decent platforms are going to continue being reasonable because they always seem to break themselves
- paulddraper 3y agoMDN doesn't like it > Browsers set required values for this header according to their active user interface language. Users rarely change it, and such changes are not recommended because they may lead to fingerprinting. > The content of Accept-Language is often out of a user's control (when traveling, for instance). A user may also want to visit a page in a language different from the user interface language. https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Accept-Language https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Ac... :shrug:
- Fischgericht 3y agoNo, IP Geolocation is not Twenty-Five Years old, you did not invent it, and you do not have a patent for it. Let's see what your patent is about: A method, computer program product and electronic device are provided for providing hyper-local geo-targeting based on validated, user-supplied geographic information, wherein the user's anonymity may be maintained. In particular, user-supplied geographic information may be collected in association with a truncated IP address. Once collected, the user-supplied information may be validated using geographic data previously derived from one or more complete IP addresses corresponding to the received truncated IP address. The derived geographic data may have been derived using a system that maps the routing infrastructure of the Internet in order to determine where endpoints on the Internet are located. The validated, user-supplied geographic information, which may be more specific than the derived geographic data, may then be used to provide more granular and accurate geo-targeting, all the while maintaining the privacy of the individual users. User-supplied geographic info. Aha. First claim: 1. A method comprising: receiving, by a computer over a network, a truncated internet protocol (IP) address associated with a user device related to a specific user; receiving, by the computer, user-supplied geographic information associated with the truncated IP address, the user-supplied geographic information not being linked to the specific user; retrieving, by the computer from a database, geographic data derived from one or more complete IP addresses corresponding to the truncated IP address; validating, by the computer, the user-supplied geographic information based at least in part on the geographic data, the validating comprising determining if the user-supplied geographic information is the same or equivalent to the derived geographic data associated with at least one of the one or more complete IP addresses corresponding to the truncated IP address, wherein in response to the user-supplied geographic information being validated, the user-supplied geographic information permits providing geo-targeted information. I may not be perfect at reading patent legalize, but this "Invention" does not make any sense to me. So someone is providing his geo location, to then receive his geo location? Yay. I've been using geo location for over 25 years now. And I have never heard about your company. And pretty much everybody uses Maxmind for 22 years now. Because they have an actual product, a website, pricing, and a free offering that's deployed on hundreds of thousands of servers. Your company website on the other hand makes me want to puke. No way to actually see any IP Geolocation services. No products, no pricing. Just BLABLABLA WHY WE ARE SO GREAT. So, guess what: No, nobody stole your idea. Nobody every heard about you or your idea, and nobody cared. Maybe instead of posting this here actually invent something that is of use, and then come back here? Yes, these have been rude words. But did you REALLY come here to get praise on this whiny narcissistic blog post of yours? Next time, please have this discussion in front of your bathroom mirror instead.
- deleted 3y ago[deleted]
- Amfy 3y agoSource of so many problems
- sanjayparekh 3y agoAgreed. But also the source of so many new possibilities. Like most things, the bad comes with the good.
- unethical_ban 3y agoAnd what a privacy nightmare, particularly with IPv6. When I see a map of my home IPv4, it's within a mile or two. With IPv6, it's on my block. But at least the companies I consult can block Chinese IP addresses from their public web presence. Chinese security will never think to stand up a server in the US or Europe. (Yes, I know it can help block noisy log generation).
- sanjayparekh 3y agoIf you're getting targeted to your block with IPv6, your ISP is likely giving away your data. VPNs are your friend.
- geraldhh 3y agoime geoip is at best able to identify the country, but yours are both scarily accurate, which isp?
- unethical_ban 3y agoATT.
- 8organicbits 3y ago> The site owners contended that they could not know where an Internet user was geographically located. Clearly, I had proven the opposite. I've spent a lot of time working with the Maxmind and other paid datasets for IP geolocation. One thing you'll quickly notice is that they disagree with each other, sometimes giving answers on different continents. There's challenges here. IP addresses are dynamically assigned. They are bought and sold to different companies regularly. That's not even getting into problems like VPNs, or remote browser sessions. The details and context are lacking here, but I disagree that you can be certain where a user is located using those tools and its harmful to believe you can.
- imp0cat 3y agoWhat's with the `?ref=sanjayparekh.com` query parameter? It's present on every link, is that some new tracking standard?
- sanjayparekh 3y agoHuh. Good question. Must be something Ghost added because I didn't do that manually. I'll have to take a look.
- geraldhh 3y agobrowsers started to limit referrer info a few years ago, this might be a workaround.
- imp0cat 3y agoYeah it looks like that, but is this an official standard that's defined somewhere. I am not sure what to search for.
- geraldhh 3y agohope this helps https://en.wikipedia.org/wiki/HTTP_referer https://en.wikipedia.org/wiki/HTTP_referer https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Referrer-Policy https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Re... https://developer.chrome.com/blog/referrer-policy-new-chrome-default/ https://developer.chrome.com/blog/referrer-policy-new-chrome...
- Sporktacular 3y agoLooks like people just aren't buying it. The self-aggrandisement and the unjustified certainty of the 25 years ago claim. Modesty in line with the achievement will be received much better.