13 ms·
It's funny, when I took a tour of the US Geological Survey, the curator of the collection hated Google (which was just a few blocks away). He said Google is gr
by jedberg 6y ago
It's funny, when I took a tour of the US Geological Survey, the curator of the collection hated Google (which was just a few blocks away). He said Google is great now, with all their maps, which were far more accurate and had better coverage than the USGS.
But what happens when they get bored with map data and get rid of it?
He had been ordered to turn over all of their historical arial archives for scanning by Google, and then told the USGS would no longer do arial scanning since Google was doing it. But there was no agreement for Google to turn over their arial scans back to the USGS.
At the time we all told him not to worry, Google would never remove data it had collected. Looks like he was a lot smarter than us.
- TheSpiceIsLife 6y agoLike we have whitewashing and greenwashing, I propose the term: Googlewashing - to proclaim “Google would never ...”
- coliveira 6y agoWell, that's the problem with the whole internet. Remember those pages created in the 90s/early 2000s? People thought they were sharing information to the whole world. It turns out that most pages created in the 90s are now inaccessible or have been siloed by big corporations. The fact that we allowed corporations to take over the internet made it an inhospitable place for everyone else without corporate backing.
- methodin 6y agoSeems like a fundamental truth of Capitalism: privatization and ultimate destruction of anything that can be monetized. Certain things are impossible without money and to make money to have to generate or consume something which leads to a never-ending cycle.
- zrm 6y agoI don't think it's any harder to create a website than it ever was. The problem seems to be that corporations have made it so easy to do it within their silos that people aren't willing to spend ten hours on something they could do in ten minutes, not realizing that they're going to spend a lot more than ten hours creating content which the company will then vaporize at random whenever they feel like it.
- quaintdev 6y agoA decade ago, there use to be celebrity websites which had forums, galleries, blogs now it's just Instagram. Hell so many prominent celebrities don't even own a domain name in their name. Also, it's not like the content has improved. Earlier their use to be HQ images in those celeb galleries now the highest resolution image is 1200x1200. The only thing that has improved is how easily a celebrity can reach millions everything else has gone downhill with respect to discussions, forums, galleries, blogs. Most of these are replaced by poor comments section. It's not just celebrities, so many independent artists are putting up their talent on Instagram and I don't have access to any of it because I need an Instagram account for that. Instagram web version is forcing to sign up if you scroll 1 page down on a profile. Sometimes I feel like we need to build cutting edge decentralized applications that will burn these walled gardens to the ground. /rant
- r3trohack3r 6y agoThe only thing that has improved is how easily a celebrity can reach millions From Wikipedia: Celebrity is a reference to the fame and wide public recognition of an individual or a group I'd posit that celebrities are celebrities by connecting with millions. A platform that offers a "celebrity" the ability to connect easily with millions seems to be worth more than a list of any other features.
- zeckalpha 6y agoWhat has changed is the meaning of the word connected.
- MYEUHD 6y ago>I don't have access to any of it because I need an Instagram account for that. Check out https://bibliogram.art https://bibliogram.art
- JoblessWonder 6y ago502 Bad Gateway
- deleted 6y ago[deleted]
- r3trohack3r 6y agoI'd argue this is a feature not a bug. The internet is a protocol for communication, not archival or retention. Any notion of persistence is owned by nodes in the network. Retrieval from an "archive" over the internet comes in the form of communication. The web introduced hypertext, and a protocol for exchanging hypertext, on top of this communication protocol. But again any notion of persistence of hypertext, and the "links" between hypertext documents, is the responsibility of the nodes in the network. They were sharing information with the whole world, but in an ephemeral medium. The web, and internet, is not an inhospitable place for anyone without corporate backing. You can host a somewhat reliable service on a raspberry pi over your home internet connection.
- wolco 6y agoYou just can't be found. You can self host but unless someone finds you some other way you are excluded.
- deleted 6y ago[deleted]
- colonwqbang 6y agoWhy do you feel that it was the job of "corporations" to preserve and archive of every page forever? In my country, all physical books and magazines which are published must be submitted to the government in X copies. The government then keeps an archive. With webpages, the problem of obtaining X copies never existed. Why couldn't the government have archived webpages like it always did with books?
- PaulDavisThe1st 6y agoIt is not that it is their job. The problem is the mismatch between the broader public understanding of the lifetime of "a webpage" and reality, when said "webpage" is inside a walled silo (and maybe even when it isn't).
- colonwqbang 6y agoI guess I don't see why anyone would expect their webpage to keep being published indefinitely with no contract or ongoing payment. Not many other things in the world work like that. Services provided by a company typically don't survive the end of the contract to provide that service. If the company itself goes bankrupt, all services cease to be provdided immediately. Typically the only organisations which can credibly commit to providing a service for more than a few years/decades is the government of a country, a well-funded foundation with a clearly specified mission, or similar.
- rikroots 6y agoIn the UK, this job is handled by the British Library. They have a legal duty to collect annual snapshots of all websites using the .uk TLD https://www.bl.uk/collection-guides/uk-web-archive https://www.bl.uk/collection-guides/uk-web-archive
- metrokoi 6y agoI believe you are misrepresenting the situation. No one expects corporations to archive and preserve all data, especially not data that they are not associated with. However, if they create a monopoly on that data they have an obligation to preserve it, especially in the case of a corporation outright aquiring data instead of simply "out competing" for data. And as everyone mentions, of course they are in no way legally obligated to do so, but they are by any reasonable standard ethically obligated. I do think that the government could and should archive data, but there is currently no system in place for doing so and likely will not be for a long time, if ever. Corporations would simply have to maintain the data that they already have.
- fiddlerwoaroof 6y agoThe issue is is that a web page only lasts as long as its funding does: private sites are great, but someone still has to pay for the server and, when they die, it’s probably going to just vanish, unless the internet archive got it.
- deleted 6y ago[deleted]
- nullc 6y ago> It turns out that most pages created in the 90s are now inaccessible Some of that is because search engines have simply stopped returning them in results even though they're still online.
- opportune 6y agoHow are big corporations preventing a web server from serving content over HTTP in old-school HTML?
- FpUser 6y agoI seem to have a distrust of corps imprinted in my brain since birth and had never fell for their candies/propaganda. All my stuff is always on my own servers with shadowing of course.
- est31 6y agoThere are laws for book publishers, requiring that they send copies to your local government's central library. In the US it's the library of congress. Some of the books they don't keep, but they do filter them by which books are important and which aren't. Maybe the same should be done for "viral" posts, such arial scans, and other data deemed important.
- johannes1234321 6y agoIn Germany the national library is also required by law to take care of digital ("körperlose Werke") media. They are still figuring out what a good way for archival of those is and are quite selective in choice what they archive, but they plan to expand on that German page: https://www.dnb.de/DE/Sammlungen/DigitaleSammlungen/dgitaleSammlungen_node.html https://www.dnb.de/DE/Sammlungen/DigitaleSammlungen/dgitaleS... English page: https://www.dnb.de/EN/Sammlungen/DigitaleSammlungen/dgitaleSammlungen_node.html https://www.dnb.de/EN/Sammlungen/DigitaleSammlungen/dgitaleS...
- tingletech 6y agoI didn't know that LoC has any discretion regarding keeping items mandatorily deposited for copyright registration. Do you have more information on this?
- wahern 6y agoElectronic works in the U.S. fall within the mandatory deposit statute, but then are excused by Copyright Office administrative rules. However, it seems they've slightly narrowed the electronic works exception (first in 2010, and tentatively for 2020) since the last time I looked: https://www.copyright.gov/rulemaking/ebookdeposit/ https://www.copyright.gov/rulemaking/ebookdeposit/
- wyclif 6y agoIn another life, I was a land surveyor and I did a lot of LiDAR work as well as heavy use of USGS data. Almost anybody except the most blinkered in that industry would have seen this coming, I think. It's just one more data point that convinces me that Google should be broken up or at least not allowed to silo previously public categories of data.
- kerkeslager 6y ago> He had been ordered to turn over all of their historical arial archives for scanning by Google, and then told the USGS would no longer do arial scanning since Google was doing it. But there was no agreement for Google to turn over their arial scans back to the USGS. Jeez, that's horrifying. Literally just giving public assets to private corporations.
- monadic2 6y agoYea most of the wind about “taxpayer dollars being wasted” is just flatulence but this is a straight up robbery.
- blitmap 6y agoI don't like this but if a corporation is a person, they have the same right to it that the rest of the public has. If the effort to USGS could be quantified in a cost, I'd expect Google to pay USGS to make the public data available? It does sound awful. I don't know what the right answer is.
- xmprt 6y agoCorporations aren't people. I can't get married to Google. If you can point to specific precedence of corporations being given access to certain data on grounds of their personhood then your argument makes sense but just because corporations are considered like people in the context of speech doesn't mean that applies literally everywhere else.
- mensetmanusman 6y agoYou will be able to mary corporations some day: https://www.nytimes.com/2020/07/01/us/somerville-polyamorous-domestic-partnership.html https://www.nytimes.com/2020/07/01/us/somerville-polyamorous...
- JetSpiegel 6y ago> I can't get married to Google. But they can still fuck you over, like when they banned my GMail account for no reason, with no warning nor explanation.
- ponker 6y agoCompanies are necessarily managed for the quarter and countries should be managed for the century.
- TheOtherHobbes 6y agoThe planet should be managed for the centuries, plural. But we're just not smart enough to understand that, never mind make it happen. Instead we prefer to cling to the bizarre delusion that billions of individuals with competing interests will somehow spontaneously self-organise into the best of all possible worlds.
- elmo2you 6y agoThat is indeed pretty much what it says on the tin. However, to be fair, it has always been the most greedy and self-interested, with already the most disproportionate power to rig the game in their favor, that have been most vocally advocating this system. No surprise there, of course. What fascinates me is how a majority of people, who certainly do not personally benefit from that system, have been made to believe that they do. Sure, political corruption, cultural indoctrination/propaganda, horrendous general education, and I can think of a few more .. but still I've always been amazed, how it appears to have canceled even basic logic reasoning among so many. Who knows, maybe one day, it will turn out to not just "correlate" with an addiction to carbs/sugars, of which the country has plenty of problems with too. Junkies have always been easy to manipulate. Until then, at least it still gives some hope that a growing number of people now realize that this system just doesn't work as it is advertised.
- jeffbee 6y agoThe USGS is currently in the middle of an 8-year 1.1-billion-dollar program to develop a nationwide digital elevation model from aerial lidar. The data, which is freely accessible, is hosted on AWS. Cute story though. The hackernewses are going to eat it up. https://www.usgs.gov/core-science-systems/ngp/3dep/3dep-data-acquisition-status-maps https://www.usgs.gov/core-science-systems/ngp/3dep/3dep-data...
- jedberg 6y agoI took the tour 10 years ago. Obviously his objections were heard. I’m glad they listened to the guy.
- jcrawfordor 6y agoUSGS is in the process of collecting that data right now, it's not from the archives, and DEM is different from USGS aerials (which are photographs) and run out of a different USGS office. This is sort of irrelevant. Making digital data publicly available is pretty new for USGS. Just a few years ago archived aerial imagery had to be ordered by mail and it was a pretty lengthy process. Topo maps (the earlier equivalent of the DEM data to which you refer) were generally ordered on paper as well up to five or so years ago, but they're in a lot more popular use so more third parties got into the business of distributing them. I've relied moderately heavily on both for some of my research and was a very painful process until just recently to get anything older than current. In the meantime, yes, Google had it all at some point, but mostly stopped using it or providing it because they obtained better quality imagery. Fortunately USGS now has a slippy map for topo and an admittedly rather clunky ESRI query service for aerials.
- jeffbee 6y agoUSGS has been providing free public access to DEM data for ages. The SRTM has been available via FTP since at least 15 years ago when I first started using it to render hillshaded maps. There's not a secret handshake needed. https://dds.cr.usgs.gov/srtm/version2_1/ https://dds.cr.usgs.gov/srtm/version2_1/
- 6y ago
- tingletech 6y ago> But there was no agreement for Google to turn over their arial scans back to the USGS. That was poor negotiation by USGS Solicitor's Office. Libraries participating in google digitization programs negotiated to keep copies of their scanned materials in the Hathi Trust Digital Library https://www.hathitrust.org https://www.hathitrust.org
- mywittyname 6y agoYou act like the Director of the USGS was acting in good faith. It's pretty likely that Eric Schmidt, or similar, already worked things out with high-level officials within the government and the USGS Director was not given any real decision making capabilities.
- stcredzero 6y agoHe said Google is great now, with all their maps, which were far more accurate and had better coverage than the USGS...But what happens when they get bored with map data and get rid of it? Looks like he was a lot smarter than us. If you would've asked me back when Google was new, and we all believed in "Don't be Evil," I would never have thought that Big Tech would end up being the Ministry of Truth and The Memory Hole.
- elmo2you 6y agoThe underlying problem here might as well be considered a fundamental shortcoming of pure/fundamental capitalism. I make no claims about the value of alternatives, or even if there are any (better ones, that is). Anything that is (no longer) of commercial value will be "phased out" and dismantled/destroyed. One might still stretch it a bit, by arguing that the commercial value of something can include its future potential value. But I personally know not a single commercial companies that ever choose that over short term cost reductions and "profit optimizations". Luckily, there are governments who acknowledge this shortcoming and build structures to compensate for it. But when governments decide to leave (almost) everything to commercial markets, then the importance of anything and everything can and will only be measured by it's commercial (contemporary) value/profitability. People have every right to vote for and support such a system. But then don't complain, when all that you will get is only what such system supports/provides.
- irrational 6y agoIsn't killing projects Google's key strength?
- raldi 6y ago> historical arial archives A font of knowledge
- cosmodisk 6y agoI think most of us are young enough to live up to the point where we would look into the mirror asking ourselves what did we do 20 years ago and nobody will really remember because you know,a few bits here,a few bits there,and all it disappeared...
- deleted 6y ago[deleted]
- Spooky23 6y agoThe funny thing is that this happened already when Google bought DejaNews and broke the interface after a year.
- pwdisswordfish2 6y agoIs this a valid reason for not using Go? I am a holdout. (Not suggesting I am "smarter" than Go users, but I can forsee issues with Go being controlled by Google.)
- teddyh 6y agoI will probably never use Go in its current situation. https://news.ycombinator.com/item?id=8733705 https://news.ycombinator.com/item?id=8733705
- parksy 6y agoI had a similar almost to the letter conversation when I did some web work for a much smaller GIS firm back in the day, but wanted to add that in my experience this isn't just a google thing but an issue with governments and outsourcing in general. Anecdotally, a close relative (and many others in her institute) designed entire curricula of learning modules for a government-owned nationwide technical college, back when online learning was newish, ~20 years ago (I think back when SCORM was fresh). These were tightly integrated into the traditional in-class offerings. A couple of years later a "trim the fat" government slashed internal capabilities and outsourced all "IT" hosting, management, etc. All of the online learning modules (which would have cost millions in man-hours to develop) were literally handed over as "content" to a company who to this day offers them back to her institute under per-student licenses (that far exceed any "hosting" costs of these basically static resources) over a decade later. This company also profits off licensing to an array of pop-up online "institutes" that don't even approach the pedagogical context needed to ensure quality education outcomes from these resources. Like a comedy of errors, from time to time some lecturer at her college will want to ask some question about the materials, their boss directs them to the company support (which is a paid service), after the issue escalates through the support tiers and they realise they need the expert knowledge of the author she'll get an email with the question, a process that can take days or weeks when the lecturer could have walked into the office next door and asked her directly, if the company hadn't stripped all author credits from the materials. If the company decides to shift business models, or goes out of business, or is acquired and scuttled, these assets get blown to the winds. There's a lot I could say about this situation, but essentially governments in general seem to devalue their assets at taxpayer expense, the IP of these assets could have been better handled rather than just giving it directly to the first company to win the contract all those years ago.
- globular-toast 6y agoNot smarter. Wiser. It sounds awful that Google has the best mapping data in the US. In the UK Google's data is awful, worse than OpenStreetMap and much worse than Ordnance Survey, the national mapping agency.
- GekkePrutser 6y agoAnd it's not even true. At least here in Europe (I can't comment on the US as I've never visited), Google Maps is really poor. It's fine when you travel by car, but when I'm hiking through the hills I'm just walking through an empty square on Google Maps. Volunteer-driven OpenStreetMap is MUCH better. And there the data is actually open and safeguarded. Governments should support that kind of project instead of corporate privacy-invading playtoys like Google Maps.