14 ms·
OpenStreetMap charts a controversial new direction
- airstrike 6y agoFor an article on maps, that image of who mapped what is terribly hard to read
- no_wizard 6y agoThe Crux of the article I feel: Open Street Maps (OSM) is free and the rest largely aren’t. Conversely the cost of things like Google Maps (as a service not as a consumer in this context) has risen dramatically so naturally big companies are turning to the free offering more and more and the worry is they will have outsized impact in the project and become the dominant body and their priorities will be pushed forward over others And not a whiff that they are contributing back in substantial ways on the whole either Seems like all giant corporations are one way or another not respecting the spirit of the mission of the organization and often aren’t receptive to community feedback in any substantial way Edit: maybe leeches (that was my previous statement) is harsh, however I stand by my assertion that the spirit of the project isn’t being taken into consideration in this instance. Whenever FaceBook, Apple etc can make it proprietary they will rather than share data and compete on things like user experience. They could do much better in this regard. I don’t believe personally that it’s the developers at that company per se that are the issue this is an issue with industry politics and open source policies etc.
- avianlyric 6y ago> And not a whiff that they are contributing back in substantial ways on the whole either How have you achieved this conclusion when the entire article is about how corporations are contributing back, and the fear that those contributions might cause the devaluation of volunteer contributions? There’s even half a dozen visualisations to demonstrate the extent of their contributions.
- no_wizard 6y agoI should clarify: I don’t mean just material code contributions but other contributions too, like monetary, data, being receptive to the community about contributions offered and such. Respecting the ethos is more in line with what I’m talking about It’s a tussle, because I personally came away that the ethos of the community isn’t being respected and the fear is they’ll overrun the mission of the organization. It’s complicated and nuanced to be sure., which is why I amended my original comment
- kevinventullo 6y agoIn my experience, it’s not even the ethos of the whole community, it’s the ethos of a few old guard European dudes. Ask nearly any mapper from say Southeast Asia what they think of corporate contributions and I think you get a different answer.
- Doctor_Fegg 6y agoThere’s some truth in that, but famously the first corporate mapping flare-up in OSM was when Facebook utterly screwed up Thailand.
- alex_duf 6y agoBut they are contributing back, that's the point of the article right? So much so the article is more about who controls the organisation. I personally see this mostly as a good thing. More data, better data, and everyone gets value out of it: users and corporations. Surely it's a sign this project is doing things right. However I think it's right that the article points at the power structure of this organisation, I think now more than ever it's important it remains independent.
- Mediterraneo10 6y ago> But they are contributing back Sometimes they are not contributing. There have been complaints about contractors employed by the big firms adding non-existent roads, tagging roads wrongly, etc. The concern is that because the big firms are so big and now have power over OSM governance, they can simply ignore all those community members who are noticing their persistent mistakes and asking them to stop.
- warkdarrior 6y agoThis seems to imply that the corporate members are inserting these mistakes on purpose. I am not convinced this is the case, as I do not see how they could benefit from creating bad maps.
- Mediterraneo10 6y agoIt is not that they are inserting the mistakes on purpose, but rather the contractors actually doing the edits are not responding to changeset comments saying "Hey, you've been persistently making a tagging error with regard to X, could you please stop?" The big corporate members are so big and powerful, they don't care if their contractors are sometimes violating OSM etiquette and failing to work together with other members of the community.
- lupire 6y agoCan bad mappers be banned? Or is the net value positive even if theyale some errors?
- grawprog 6y ago>Conversely the cost of things like Google Maps (as a service not as a consumer in this context) has risen dramatically so naturally big companies are turning to the free offering more and more and the worry is they will have outsized impact in the project and become the dominant body and their priorities will be pushed forward over others I don't know if this has changed with newer versions of the google maps API, but years ago when I had the choice of using google maps or OSM, the biggest motivator in my decision, when OSM was still a lot less complete, was to do with Google's licensing. There was a clause that implied they'd have some rights to reproduce and use our data and that was totally unacceptable for our use case. OSM was completely free to use without worries that google was somehow going to be able to use our data in some way.
- akira2501 6y ago> When it launched in the mid-2000s, most spatial information was owned by governments, and was difficult or impossible to access. It bothers me that this sentence is used as if the facts behind it are a logical arrangement of consequences. The fact that people are prevented from accessing data that they funded, and by all rights own, is an absurdity. I appreciate that OSM exists, but in a perfect world, it shouldn't have to.
- Mediterraneo10 6y agoSome of that government data existed in the form of physical maps, and the data was difficult to access because it had never been digitized, even government-internally. No one was prevented from digitizing it themselves, and in fact a lot of early OSM data came from enthusiasts digitizing old US Army maps because, indeed, they were public domain. Then you have cases like the Ordnance Survey in the UK where apparently a lot of the data is neither freely available to the general public, nor paid for by the general public.
- malandrew 6y ago> a lot of early OSM data came from enthusiasts digitizing old US Army maps because, indeed, they were public domain But that's the rub, we the taxpayers have paid for all the map creation, even the new high resolution ones with far greater accuracy, yet we're stuck with these older, lower resolution and likely out-of-date maps. Even the new maps should be public domain.
- mc32 6y ago?? Some countries don’t have the resources for high precision maps. They have old maps from whenever they were commissioned.
- paxswill 6y agoIf you're referring to maps produced by the US government, they are in the public domain. Early on it sounds like there wasn't an easy way to transfer "raw" map data around (hence the tracing), but it's pretty easy now to access official maps in full resolution: * US Geological Survey: https://www.usgs.gov/core-science-systems/ngp/tnm-delivery https://www.usgs.gov/core-science-systems/ngp/tnm-delivery * National Park Service: https://mapservices.nps.gov/arcgis/rest/services https://mapservices.nps.gov/arcgis/rest/services * US Forest Service: https://www.fs.usda.gov/visit/maps https://www.fs.usda.gov/visit/maps (the API access is further down that page). Those linked above typically available through a standard API (Tile Map Service), as well as ESRI's moderately well documented REST API for accessing shapefiles and features. My one complaint about this data is how the USFS manages their data. In that case it seems each service region defines how data should be made available, so you have a pile of different methods for accessing things like road/trail features, or points of interest (in many cases, it comes down to "fetch this pile of ZIP files").
- polote 6y ago"Tensions grow" is addresses at the very end of the article > While Sarkar agrees that a diversity of perspectives can be a strength, he also warns that the private sector could overshadow the work of the hobbyists and humanitarians who have made OSM what it is to date. Volunteer editors could lose interest in participating if they feel their work is devalued, which could in turn diminish the map’s quality and coverage, he said. Such devaluation could lead to what he called “digital gentrification,” in which the very attributes of OSM that drew its earlier users are degraded by its newfound fame. Hum, ok so you are having rich people problems
- dang 6y agoThis comment breaks quite a few of the HN guidelines. These, for example: "Don't be snarky." "Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith." "Eschew flamebait. Don't introduce flamewar topics unless you have something genuinely new to say. Avoid unrelated controversies and generic tangents." "Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something." Would you mind reviewing https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html and sticking to the rules when posting to HN? We'd appreciate it.
- soheil 6y agoCan open source wiki/user contributed style tools implement a type of captcha to protect against big corps' influence? I see major entities regularly fiddling with wikipedia articles to insert bias. Why not turn Google's Recaptcha back on itself?
- mtmail 6y agoThe article isn't about Wikipedia articles but about OpenStreetMap. Unlike articles it's much harder to add bias to data points, e.g. a street or position of a house, that can be verified.
- soheil 6y agoI thought this article was about control over OSM, not sure why it's so difficult to make parallels between this and wikipedia. Selectively adding accurate data points can very much bias a map, e.g. all you see is McDonalds and never a local restaurant
- zaik 6y agoIf McDonalds were to add all its restaurants to OSM what would be the downside? They are not removing other restaurants from the map. I fail to see how adding accurate data points would hurt OSM even if it is done "selectively".
- soheil 6y agoCherrypicking causes biases [0]. A highly non-random distribution of data points is the issue here. No one has to remove other restaurants, it's just that there could be 10x more effort put in to add detailed McDonald data points. [0] https://en.wikipedia.org/wiki/Cherry_picking#In_science https://en.wikipedia.org/wiki/Cherry_picking#In_science
- maxerickson 6y agoOSM has lots of other sources of bias, so it isn't really an additional problem. For instance, someone has enthusiastically mapped Coke County, Texas: https://www.openstreetmap.org/#map=7/32.083/-98.465 https://www.openstreetmap.org/#map=7/32.083/-98.465 I haven't looked into it, but chances are it is just a result of them living there, and it creates a huge bias in the data in Texas.
- paganel 6y agoI thought they were talking about wikimapia.org, still upset that Google hasn't offered them a free API key or something like that, that project is awesome. Among other things it was one of the best ways to follow the Syrian Civil War, at the beginning, at least.
- maxerickson 6y agoI skimmed through subtitles and things for a better title and there wasn't really anything.
- paganel 6y agoNo worries, it's just that your title reminded me of that website which I used to visit a lot more often in the past.
- fireattack 6y agoThe wikimapia.org isn't bigger is really a shame. That site is like a treasure. To be fair, how interesting it can be totally depends on the community of your city. The place I used to live seem to have one or two people that are very passionate, almost all the buildings are marked and often have interesting tidbits and trivia attached to them. I used to spend hours reading it. The city I currently live, on the contrary, is relatively dry in that regard. Still useful, but not something I can binge-read on. On the technical side though, I feel like they're always lacking even before the whole GMaps API thing. It has so many bugs (and site is slow), to a point that viewing or editing become annoying from time to time.
- soupysoupysoup 6y agoI was very passionate about Wikimapia as an actual wiki for everyday people to add to in the first few years. There was a lot of graffiti, but it was also building into a great resource for local interest and history. Then the cost concerns picked up and deletion wars began. The emphasis was on removing all places and content not considered "significant" and current. Real estate and business became the primary focus and the wiki aspect fell away. I loved how that site started.
- samaparicio 6y agoOf companies mentioned in the article, the asymmetric contributions to OSM that bother me the most are AllTrails and Strava - 2 companies that heavily rely on trail data sourced from OSM. AllTrails does close to zilch to help put trails into the maps, even though the majority of trails are user-generated content. Strava has let "Slide", their one project that could help put trails on the map, die an ungracious death. If you build a whole business model on top of free data, it may be worth considering improving that data.
- notatoad 6y agoDoes strava actually use the trail data from OSM? as far as i can tell, the routes on strava are entirely contributed by strava users and don't come from OSM in any way. The two maps follow the same paths obviously, but at least in my region the routes and segments on strava don't ever seem to start or stop at the trail intersections in the OSM maps and often cross unmapped and unofficial connectors that don't appear on OSM. The extent of their reliance on OSM trail data seems to be that they use MapBox tile images and those tiles sometimes have OSM trail names marked on them.
- mtmail 6y agoStrava's map are based on OpenStreetMap, there is attribution in the bottom right corner of every map (not sure where in the mobile app, I'm not an active user). The parent comment probably talks about giving Strava user uploaded data/tracks back to the OSM community so they improve the map (or add new paths themselves). In a way they already do https://wiki.openstreetmap.org/wiki/Strava#Data_Permission_-_Allowed_for_tracing.21 https://wiki.openstreetmap.org/wiki/Strava#Data_Permission_-... Allowing tracing is more than other companies offer and gladly accepted. It regularly leads to new unmapped paths discovered, sometimes on private ground (military areas) that are otherwise inaccessable to an OSM mapper.
- notatoad 6y ago>Strava's map are based on OpenStreetMap yeah, that's what i was saying about the tiles - their tiles come from mapbox, which means they include OSM data and therefore must include the attribution. but the claim was that they're heavily reliant on OSM's trail data, and I just haven't seen any evidence of that.
- aero-glide2 6y agoI've read the whole article and I don't get what its trying to say. Corpos are not contributing enough? They are contributing too much and thats changing the culture?
- maxerickson 6y agoThere's a fairly large number of long time contributors to OpenStreetMap that only want driveways if they are added with deep passion (I'm like ⅔ serious). There is a real issue where it doesn't make sense for a small volunteer organization to manage a massive amount of data that is not of interest to a broader set of users. It's not a huge issue, because the narrow interests mostly understand the basic issue, there's just not universal agreement about what is broadly useful or not.
- sevenf0ur 6y agoI had the same impression. Amazon moved into our area and someone from their logistics has been contributing a lot to OSM mostly documenting service roads. They have the resources to really add to level of detail of OSM. I see it as a net positive.
- phkahler 6y agoI thought that was the point, everyone improves the part they care most about and in the end we have something very comprehensive. You even get people who care a lot about filling gaps just for the sake of completeness. So long as nobody corrupts the big picture it should be fine.
- beej71 6y agoPersonal take of a longtime OSM contributor: I don't think it's an issue and welcome any improvements from any directions. I also don't care if megacorps use the data to make jillions of dollars and never contribute. But I know others feel differently. If someone manages to take over OSM and put a restrictive license on the data, we'll just fork from the last open version and keep on doing what we do best: we map!
- kylegill 6y agoI feel like your take is a beautiful encapsulation of the open source mindset, taking on passion projects because it's fun and meaningful to build!
- coldpie 6y agoI work in, love, and use almost exclusively open source software and I don't agree with your description. We wouldn't be anywhere if it was only passion projects. For me, I like open source because it avoids wasted effort: everyone works to push the state of the world forward, instead of hoarding their own work for their own profits. It's simply the best way to make software. But that doesn't require doing things only because it's fun and meaningful. Doing work on open source software because you can get paid to do it is a perfectly valid reason to work on open source software.
- kylegill 6y agoThat's a fair point. Perhaps my statement paints too broad a brush. I get paid to work on open source software, so I agree it's not only worth doing because it's fun and meaningful. I guess I feel lucky hitting the sweet spot of enjoying the work I get to do on open source and be paid for it at the same time.
- dkjaudyeqooe 6y agoI don't think he's saying that his take should exclusively be the reason to work os OSS, but rather he thinks that the freedom to use OSS should be the same for everyone. You both state the major reasons why people do it.
- RGamma 6y ago"Such devaluation could lead to what he called “digital gentrification,” in which the very attributes of OSM that drew its earlier users are degraded by its newfound fame." A look at much of the internet and the declining role of academic guiding principles wrt technology and its governance tells you where this might be headed.. Hope OSM somehow can find a golden middle way that incorporates "grassroots"/cute data like benches as well as large-scale and tedious to maintain data such as roads or road signs. Don't let 'em eat you.
- renewiltord 6y agoI work in geospatial stuff and we use OSM data. There's things I'd contribute back but the community is notoriously prickly. You make a couple of mistakes not made out of malice and they'll assume you're corpos out to fuck everyone because that's what evil corpos do. The downside is high (you get a bad reputation as being an evil corpo) and the upside is limited. So, for the moment, we just hold the corrections on our side and overlay them on top. If you're an actual corp you don't care about that, but being labeled an evil corpo will ruin things if you want to cooperate. And we're a small startup. I'll revisit it some time but we're being cautious about it.
- maxerickson 6y agoOne pretty low risk way to share back is to just publish the issues somehow. I guess you could still get criticized for not fixing them yourselves though.
- Maxious 6y agoYou can add Map Notes which aren't seen as threatening to the extent some apps that use OSM as their base map let their users directly send them in https://wiki.openstreetmap.org/wiki/Notes https://wiki.openstreetmap.org/wiki/Notes
- tux1968 6y agoEdit: It's a shame you can't find a way to make those edits available to OSM.
- maxerickson 6y agoThis isn't welcome behavior (I think there's not significant technical limitation on it though). The things lots of people in the OSM community want to see are willingness to cooperate and willingness to communicate. Making throwaway accounts obviously doesn't accomplish those things. (there's value into letting people quietly make contributions; reducing community hassles associated with systematic changes isn't really where that value lies)
- neonate 6y agohttps://archive.is/DSCa4 https://archive.is/DSCa4
- crazygringo 6y agoThis article makes zero sense to me. It's arguing that corporations are contributing data to OSM, but that this somehow... changes the proportion of what kinds of things OSM covers? That traditional users have added "hyperlocal features, such as a neighborhood bench or informal walking path" while coporations are adding "roads, buildings, and all other points of interest" and "a particular emphasis on improving road data". How is this anything but good? As long as data is correct, the more data the better -- proportions are meaningless. Buildings and roads aren't taking away from benches and paths. And I'm pretty sure buildings and roads are benefiting all users anyways, no matter who contributes them. I'm utterly baffled by what logic the author imagines this is a bad thing. The data is open, so it's not like corporations are winding up with exclusive ownership of anything. So what's the problem...?
- londons_explore 6y agoI think the concern is big companies might get into governing positions and make decisions about the projects future... For example, they could decide to divert some efforts into a commercially licensed 'extended' dataset, or they could sign restrictive deals to get hold of 3d laser scan or satellite/aerial imagery that isn't so easy for volunteers to collect.
- crazygringo 6y agoThanks. I guess I just ask, is there any basis for that fear though? The OpenStreetMap Foundation's governance [1] isn't tied to who contributes data. Is there any evidence they are being "corrupted" in any way at all by corporations adding data? And like any open project, if its governance were captured by "bad guys", users can always fork it and "vote with their feet" since the data's open. If OSM really was being subject to a hostile board takeover by corporations then obviously that would be hugely newsworthy and concerning. But it's like the article is trying to stoke fears of this while presenting zero actual facts to support it. [1] https://en.wikipedia.org/wiki/OpenStreetMap_Foundation#Governance https://en.wikipedia.org/wiki/OpenStreetMap_Foundation#Gover...
- 6y ago
- asperous 6y agoTrying to piece together what the actual concerns are: * Mapping is not purely factual, some things can be mapped in different ways and corporations might map things that conflict with how normal people see them. Maybe an example would be deleting a commonly used path through cooperate headquarters that was made for staff/visitors. * Too much data in niche areas like driveways overwork volunteers and steers attention away from citizen areas of work * Governance model, fears corporations will get too much control through sponsorships I see these as valid issues but I think they can be worked through. For me it has been extremely nice to have a free and open data source for projects and the OSM data model is really easy to use I think. I feel the benefits outweigh the problems but I am only a user looking from the outside.
- fennecfoxen 6y ago> Maybe an example would be deleting a commonly used path through cooperate headquarters that was made for staff/visitors. I cannot believe that this example represents a meaningful source of conflict.
- Doctor_Fegg 6y agoAs a long-time OSM contributor, 1 is the only one that bothers me. We've had a bit of an issue in the UK with Amazon Logistics mappers blatting away some of the nuance in rights-of-way mapping (which is quite a complex subject in UK law) as they map driveways for their own use. That's not a massive problem in itself - OSM has reasonably good communication mechanisms (particularly changeset comments), and there's a clear Organised Edit Policy which most of the big guys follow. It's just a challenge because of scale: it's hard for part-time, unpaid volunteers to spend hours chasing after the countless Amazon contractors who are sitting editing OSM all day. I know we've lost a few individual contributors because of this, though more in the US than in Europe. But this is mostly growing pains. With goodwill from all sides I don't see any reason it won't be resolved.
- lucb1e 6y agoFor the first one: > deleting a commonly used path through cooperate headquarters that was made for staff/visitors That would be vandalism. The correct action is adding the tag: access=private https://wiki.openstreetmap.org/wiki/Tag%3Aaccess%3Dprivate https://wiki.openstreetmap.org/wiki/Tag%3Aaccess%3Dprivate OSM has a rather straightforward way of mapping things: if it's there, we map it. If the USA claims to own Poland, then we do nothing. If the USA actually occupies parts of Poland, then we change the tags to reflect that reality. Not to indicate that they own it, perhaps, but at least to indicate that it's stably under their control. Conflicts (I'm a moderator in an OSM chat, it can get very heated) mostly arise from people who don't like reality and want it to be shown differently. But their issue is with the renderer, e.g. OsmAnd, for showing it as belonging to what they perceive to be really theirs and unfairly occupied. But that doesn't change what the underlying data should show: reality. I'm having a hard time thinking of what would create a true conflict without clear solution.
- grapecookie 6y agoosm has great maps, many of the alleyways in my hood are present, great for charting out meandering walks.
- lucb1e 6y agoSomeone you know might have mapped that! Local data usually comes from the locals. If you enjoy it, one easy way to also contribute is with the StreetComplete app, which just asks you questions like "is this street lit" (my girlfriend actually asked me for that data once, if I knew how to figure out which roads are lit, so she could go running after dark and plan a good distance without going into dark areas).
- blendergeek 6y agoI am a very active OSM contributor. I am very pleased that corporations are helping us with the map. It can sometimes be annoying when somebody who isn't from the area messes some complicated intersection based on old satellite imagery. It is awesome when a corporation adds large numbers of features that I never would have added. More contributions is a net positive. The only concern I have is that corporations may seek to prevent OSMF from offering competing map services. Mapbox might, for example, seek to hamstring the openstreetmap.org tile server in order to push people to their commercial offering. This is largely theoretical but is a large concern of mine. As long as core technologies are Free/Open Source, we can always pack up and fork if it becomes problematic.
- maxerickson 6y agoThe status quo is (roughly) to resist adding capacity to the osm.org servers anyway. Not so much to push people to commercial offerings, more to avoid growing the resources required to operate the foundation and site.
- kgin 6y agoAm I reading this correctly that some volunteers are upset that their edits represent a smaller proportion of total edits because big companies are adding lots of data? But in absolute numbers the volunteer edits are still the same? If that’s the case, is that essentially asking for a map with less data so their own contribution can be a bigger fraction of the total data?
- ris 6y agoThis article could have been written at any point in the last 5 years really, no matter how much the headline tries to make it sound like news.
- djrogers 6y agoThis article seems to take the absurd position that these companies contributing to OSM are making it worse. One can only imagine the article written in the alternate universe where Apple et.all used the data but didn’t contribute their improvements back - any chance at all it would be a positive one?
- tomaszs 6y agoCorporations have a broad set of methods to defend themselves from bad actors. They also have money to set them up, or influence own direction. It is an interesting question how open project should defend against such actions. Without money and without a law protecting them. As an enthusiast of open source movement especially, it is worrying that such projects are easy targets for wrongdoing. Examples of such actions could could fill a book or two. This is happening for years.
- cookiengineer 6y agoI understand the potential nightmare scenarios that the author describes, because the author is worried about the sheer amount of "editing capabilities" of a company compared to a small community of OSM editors. But doesn't that automatically imply that the current way of verifying OSM data is flawed and needs a better architecture? Setting aside my personal opinions about feasibility... I think that this is actually a valid use case for a proof-of-map based system that removes the statistical power of a company with too many (maybe unintended) potentially malicious editors.
- ZeroGravitas 6y agoIt seems rude to mention Strava in conjunction with withholding data in this way as I'm fairly sure they have helped to contribute back anonymized gps traces to the community for tracing of biking and hiking routes. https://wiki.openstreetmap.org/wiki/Strava https://wiki.openstreetmap.org/wiki/Strava Similar to BSD licence, this is beyond their legal requirement and is some kind of token of good faith in what seems a mutually beneficial relationship. I'm sure they could do more and it's an open question on how to get those that benefit most to contribute in similar proportion but I'd think there must be better targets to call out.