6 ms·
Gisgraphy – open-source geocoder based on open data
- xs83 6y agoThis looks severely out of date, even with the best data sources this data gets stale very quickly unfortunately.
- Reventlov 6y agoI recently moved to Belgium (Wallonie) coming from France, and it's a nightmare with regards to addresses… Even google has trouble finding my home address, or it's off by a few hundred meters. I can't stress enough that it should be one of the job of the state to do this or make this happen (e.g. in France we have https://fr.wikipedia.org/wiki/Base_adresse_nationale https://fr.wikipedia.org/wiki/Base_adresse_nationale which, restrospectively, is probably why I never had any problem with addresses in France).
- Uberphallus 6y agoFrance is just superior to every other country in regards to address data access, and anything geography really. In the worst offenders, you have UK, where Royal Mail charges you for postcode data [0], or China where private mapping is simply illegal [1] and you have to go through some state-approved cash register (i.e. NavInfo). [0] https://www.poweredbypaf.com/licence-our-products/licence-agreements/pricing/ https://www.poweredbypaf.com/licence-our-products/licence-ag... [1] https://en.wikipedia.org/wiki/Restrictions_on_geographic_data_in_China https://en.wikipedia.org/wiki/Restrictions_on_geographic_dat...
- Gys 6y ago> France is just superior to every other country in regards to address data access, and anything geography really. That is a very bold statement? Do you have a source for that?
- maelito 6y agoThe simple fact that France provides lots of APIs and open data, including the API BAN (Base adresse nationale) one cited above is a first reference which gives confidence from the perspective of a developer. https://geo.api.gouv.fr/adresse https://geo.api.gouv.fr/adresse https://www.data.gouv.fr/fr https://www.data.gouv.fr/fr But you're right, other countries could do as well, in their language. It's hard to be aware of all the initiatives.
- Uberphallus 6y agoIt's bold, and in many ways it's just my opinion, but having analyzed the ease data access of most developed nations, the French data sources are the only ones I felt like I wasn't missing some basic data in a significant manner. Cadastre is lacking postcode-wise, but it can be easily complemented with the data here [2]. Sibling parent already mentioned BAN, but you can also check cadastre [0] which is the main source of polygon data for France on OpenStreetMap. Under the general subdomain [1] you have access to all sorts of stuff, but geography wise, there are plenty of geotagged aerial photographs, both historical and current. You also have shapefile data for towns, regions, postal codes, you name it. No shenanigans, all official, verified, and regularly updated. [0] https://cadastre.data.gouv.fr/ https://cadastre.data.gouv.fr/ [1] https://data.gouv.fr/ https://data.gouv.fr/ [2] https://datanova.legroupe.laposte.fr/explore/?sort=modified https://datanova.legroupe.laposte.fr/explore/?sort=modified
- maelito 6y agoYou can also visualize the price of all the residential transactions in a given zone. This house was sold twice, in 2015, in 2018, at 350 000€, for 105m² of constructed area, and 150m² in total. I guess it is groundbreaking for most countries. https://app.dvf.etalab.gouv.fr https://app.dvf.etalab.gouv.fr
- teruakohatu 6y agoNew Zealand has very high quality data. Every single address is in a open database that can be queried or downloaded. It also includes building outlines, roads, land parcel shapes, aerial photos, elevation data and more. OSM for NZ was originally copied from official data, and even before OSM the community used the open data to make high quality map files for GPS devices that were superior to the paid maps. It would be nice for property prices to be included the central government data. It is free and publicity available but from each municipality or many websites that republish the data along with analytics. https://data.linz.govt.nz/ https://data.linz.govt.nz/
- lucideer 6y ago> In the worst offenders, you have UK, where Royal Mail charges you for postcode data Actually, the UK is kind of a funny situation. A number of years ago the Ordnance Survey began publishing postcode data under a free (CC) licence. Royal Mail wasn't too happy, but as Royal Mail's APIs were a bit simpler and more direct (OS service was SPARQL-only) so I guess they didn't feel threatened enough to change their pricing. I worked for a company that had an account with Royal Mail at the time and I was tasked with parsing OS data. That's many years ago and now that I revisit the OS offerings have changed. They appear to have relicensed, and split their offerings between a free db[0] without full addresses and a commercial db[1] with full addresses. Either way, Royal Mail may have the established customer base but I wouldn't look to them exclusively to see who's "leading the way" in this space in the UK. [0] https://ordnancesurvey.co.uk/business-government/products/open-map-names https://ordnancesurvey.co.uk/business-government/products/op... [1] https://ordnancesurvey.co.uk/business-government/products/addressbase https://ordnancesurvey.co.uk/business-government/products/ad...
- laurensr 6y agoIn Flanders (for non-Belgians: the northern Dutch-speaking part of Belgium) there is CRAB ("Centraal Referentieadressenbestand" / "Central Reference Address File") which contains the lat./long. for every address in Flanders. It can be accessed as a map layer at http://geopunt.be/ http://geopunt.be/ or as open data at https://overheid.vlaanderen.be/informatie-vlaanderen/producten-diensten/centraal-referentieadressenbestand-crab https://overheid.vlaanderen.be/informatie-vlaanderen/product...
- dhekir 6y agoAfter moving to a newly-finished building, I realized most companies didn't have up-to-date databases and some forms prevented me from correcting the "mis-corrected" addresses. Missed a few deliveries during the first few months/years. On the other hand, having lived in a country where such databases were notoriously unreliable, such automated processing didn't exist, so I didn't encounter that problem. Sometimes, having something work "way too well" can lead people to believe it's perfect, and enforce it too strictly.
- Uberphallus 6y agoI'm surprised I hadn't seen this project before. I had been dabbling with the idea of a geocoding service that is highly accurate based on open data, but gave up because data quality is all over the place even for countries with excellent open data access (France being the gold standard in my book). I found that to have accurate geocoding I had to have an ETL stack that pulled data from 2-5 sources per country, with country-specific code for basically every country, and that's just to store usable data. Even keeping it to the major economic powers felt too daunting, nobody wants a partial coverage geocoder and I don't want to be a one man data janitor gig, which is what the whole thing felt like. And still large swaths of countries are totally uncoded for all sorts of reasons. A quick search shows some of the problems I found in my quest, and some new. 1. Wrong postal codes for certain addresses, e.g. Place de Gaulle, Antibes, shows 06160 but it's 06600. It's probably taken from cadastre or nearest OSM tags, but it's wrong, different parts of the town have either of the postal codes. For France, the postal code relations/polygons from OSM are accurate, just don't take postcode info from anywhere else, really, unless for some reason your point falls within France but somehow out of any postal code polygons. 2. Missing addresses. For France, I did some analysis on open data to find what street names were the most common, and found ~15k steets/squares/etc named "de l'Église", due to basically every town having at least a church and naming their street/square after them. Not sure if a problem with the data or with the parsing, but it only shows a few dozen. 3. While OpenAddresses is doing an amazing job, I only found the coordinate data to be accurate, and not always. Most of the fields in their own JSON are empty (postcode, district, region, and sometimes even city), but Gisgraphy takes them at face value, e.g. first result for Улица Деревянко is just that, it only shows street name. Also the coordinates are broken: 0.140642,34.6784995 falls either in Kenya or Algeria (coordinate swap is also rampant in many sources, which is a another topic). That is the official data from Kharkiv, Ukraine, which probably geocodes the locations in a different system than WSG84 for, you know, reasons. OA tends to focus on easy to process data, and can't blame them, since the state of the whole geocoding world is an absolute clusterfuck. 4. Related to 3, OpenAddresses only has (had?) two towns from all of Ukraine (Kharkiv and Dnipro) with really terrible data. But OSM data is also fed to their model, so data overlaps, sometimes with different scripts, or languages. So the street above, "Улица Деревянко", which is in Russian btw, appears again as "Дерев’янка вулиця" which is Ukrainian. The whole l10n/i18n part of geocoding is another tough problem to solve, because letters written to Derevyanka Vulitsa will arrive as well, transliteration data is spotty at best, but for many languages it can be transliterated through software, again, depending on many factors. That said, I'd love to work on a project like this as part of a team.
- wenbert 6y agoI've had a pet projects that involved a lot of geo-things. I've tried heaps of ways to do it but nothing comes close to Google unfortunately. Especially in non-USA addresses. Are paid options any better? Like the one from Arcgis? Or is google still more accurate?
- Uberphallus 6y agoDepends on the scope of your project, but for address data the best I found is Loqate[0], which is IMO very expensive but also very good. I'd only target their API if I'm making/saving money in the process, which kinda limits its use for toy projects. Google's accuracy varies wildly, and in most regions I find OSM Nominatim better. [0] https://www.loqate.com/ https://www.loqate.com/
- dagw 6y agoin most regions I find OSM Nominatim better. What regions? I work in GIS and have tried Nominatim in several projects, and it always ends up being so error prone we have to abandon it.
- Uberphallus 6y agoI briefly checked Nominatim against Google head to head a few months ago, and except for messes like Spain, most cities of Western Europe and North America have similar accuracy, with no clear winner. Google results that are wrong are very wrong, whereas Nominatim has weirder results more often. But that's for cities, in anything rural/mountain Nominatim takes the lead. Google seems not to care for addresses that aren't residential or a business. Arguably most geocoding uses are shipping things and business info, so most commercial efforts go that way. Then some areas are just abandoned by Google. When I lived in Ukraine I tested some addresses and about 1/10 of the requests didn't work or were just wrong, and that's leaving aside the fact that it always showed 01001 as postal code on every reverse geocoding within Kiev city that I threw at it. The only information that was reliable was business data, and mostly because of businesses themselves updating it. The transliteration was software based and often wrong. Russia and Central Asia are also a big mess, though big cities tend to have OK data, but my feeling is that Google dropped the ball against Yandex and they just don't care anymore; not their turf. It might have changed for Ukraine since, since there has been a push to drive away all Russian techs, maybe someone can shed some light on the subject.
- tomjuggler 6y agoIf this works it will be really useful. You know how much Google charges for reverse geocoding these days!
- adonese 6y agoI was literally one hour ago talking to my previous professor and supervisor regarding a reverse geocoding solution that targets local consumers!
- xiekomb 6y agoThere is also Pelias which is a very good open source geocoder: https://pelias.io https://pelias.io