9 ms·
Online ID / age verification: the death of online search
- djrogers 5y agoThis sounds like it would create a some new challenges for search engines, but the article itself offers a number of ways to address those. Given that, and the massive amount of money in search, I think the headline falls somewhere between clickbait and a flat-out lie.
- avhon1 5y agoHow much money is in DuckDuckGo, Mojeek, Gigablast, YaCy, or other minority search engines? If indexing material requires serious resources, the only viable search engines will be the huge ones.
- dane-pgp 5y agoNo doubt Google will come up with a way for search engines to authenticate to the sites they are spidering, which will be just "Open" enough that all their competitors can implement it for free (but not have any control over the evolution of the technology). Sites would just have to decide which search engines they want to allow to spider them, which will probably be a hardcoded list in a webserver config file somewhere, with the associated public keys. If we're lucky, webserver package maintainers will try to keep these lists up to date, and Google may even contribute some funds for the development effort, doing just enough to stop this system from triggering an anti-trust investigation.
- ivan_gammel 5y agoGovernment can offer rather simple infrastructure to enable digitally signing crawler requests and any legal entity should be able to acquire and renew signatures at very low cost. Total implementation costs for search engines won’t be high in such case.
- dredmorbius 5y agoThe article is a draft concerning UK Internet policies for which suggestions are solicited. I'd seen it posted to Mastodon earlier. Critiques are very much on point.
- userbinator 5y agoWhy am I not surprised it's the UK... If only Orwell were alive today, I wonder what he'd think.
- shadilay 5y agoHe'd be in prison.
- pjc50 5y agoThis is probably going to go nowhere. It fell over last time: https://www.bbc.co.uk/news/technology-50073102 https://www.bbc.co.uk/news/technology-50073102 It's not even an important front in the culture war.
- pessimizer 5y agoAll of these things fail half a dozen times before they succeed.
- Nasrudith 5y agoWhich is why there has to be a punishment for anybody stupid enough to propose or vote for the bill. Throw them out on their ass and they'll get the message.
- a1369209993 5y ago> there has to be a punishment for anybody stupid enough to propose or vote for the bill It's called treason. For example: > Treason against the United States, shall consist only in levying War against them, or in adhering to their Enemies, giving them Aid and Comfort.
- AnimalMuppet 5y agoNice sentiment, but it's a UK bill. Helping the government spy on people might not be treason in the UK.
- a1369209993 5y agoI was using that more as a example than a citation, but I suppose that wasn't very clear; edited.
- pjc50 5y agoProposing bad but popular legislation isn't treason, and you can't use the legal system to ensure good politics. The US shows the limits of that approach - many important civil rights are the results of "judicial activism" in the face of legislators, and the legislators remain really upset by that. Also the UK constitution really does not work that way. Formal censorship was only abandoned in the 1960s and "official secrets" are still illegal to publish.
- woliveirajr 5y ago> In other words, forcing users to prove who they are, or at least how old they are, before they can access the restricted content First we protect children. Then we protect specific groups. Then they redefine who should be protected of what. In the end a few protect all the others from knowing things they shouldn't know. And knowledge is power, as always.
- Nasrudith 5y agoReally if you want to protect children don't make a goddamned dystopia for them to grow up in. We all know about the evil manipulators who favor that lie but frankly those stupid enough to believe bear moral agency as well.
- panta 5y agoThink of the children! …They could grow some critical thinking abilities otherwise…
- vkou 5y agoI would like to point out that a child not having access to the internet is not necessarily a 'goddamned dystopia', it's just how the world has been from the time of the first ape that stood up, to the Eternal September of ~1993.
- cocoafleck 5y agoI agree, but keep in mind that children grow up in a society, and make friends in school. You are influencing their relationships by restricting their internet access.
- true_religion 5y agoSure, but the article is talking about government action. If every child in the UK grows up with age restricted internet then no ones relationships will be disadvantaged. The only thing that would be influenced is cross national relationships, and sitting in a separate country probably affects that way more than having equal access to the same webpages.
- j56no 5y agoAge is going to be another credential, based on signatures that browser will be allowed to present. Spiders will have their signatures, which cannot be copied, eg think how SSL client certs work. Now, are sites going to require age credentials? sounds like a GDPR v2 cookies story.
- j56no 5y agono idea why ppl are downvoting, maybe don’t understand? disagree? Anyway some big companies are already working on tech that enables this implementation, so it’s not sn impossible scenario.
- bserge 5y agoSome argue linking real identities to online accounts will reduce, well, all negative activity. Facebook, Weibo and other smaller platforms around the world prove that's not going to happen. (Too) Many people are still going to be trash even with their actual identity out in the open. So just leave the Internet be, for the love of everything.
- criddell 5y ago> Some argue linking real identities to online accounts will reduce, well, all negative activity. I don't think anybody is arguing that it will reduce all negative activity, just some.
- BuildTheRobots 5y agoIs the plan to make real identities publically viewable? Seems like it's either a data breach waiting to happen or makes it much easier for the worst to dox and target people.
- closeparen 5y agoThe whole premise of “doxing” being a problem is that people have a right to say things on the internet that would get them in trouble in real life. I think the pro-real-names position would argue that it is net negative for society for people to have this ability, we should only be saying aloud what we are willing to put our reputations behind. I don’t agree with this position, but afaik that’s the position.
- ellenhp 5y agoI know you said you don't agree but you left that position up without a rebuttal so here goes. What if someone managed to dump of the personal information of everyone in an online support group for LGBT folks and published it. That's doxxing too and this would do nothing to mitigate it.
- 5y ago
- tyingq 5y agoThis article could really use some context. It's not clear what proposal, from who, where, etc.
- dredmorbius 5y agohttps://news.ycombinator.com/item?id=27849888 https://news.ycombinator.com/item?id=27849888 The first paragraphs of the article itself address this. Is that insufficient or unclear?
- zodPod 5y agoMore of governments who have no idea how technology works trying to solve technology problems.
- DethNinja 5y agoBelieve me they got a pretty good idea, they know knowledge is power and they want to limit the access to it.
- dylan604 5y agoI see government in different levels in this discussion though. FBI/NSA/etc are very technically capable when they need to be. Congress however, are very not technically capable. For example take comments asking to change the orbits of earth/moon to help climate change, the internet is a bunch of tubes, and other unintelligent sounding comments does not lend to a sign of technical understanding. The scary thing is that these are the morons saying what is/isn't legal, and the tech savvy arms are using that to their complete advantage to get away with everything.
- dmje 5y agoI'd argue that kids need the tools and techniques to understand how to deal with dodgy online content, rather than locking it away. Prohibition tends to drive things underground; I'd rather have (and am having - I have 2 teenage kids!) realistic and honest conversations about porn and other content. I don't lock my router to stop adult site access, instead we're having a conversation about it. I'm under no illusions, btw. I know they'll access it. I know I did as a teen (albeit magazines rather than the web) but I think a dialogue is sorely missing about damage, the impact on women, body image, etc etc. The more this is pushed into a black/white old enough / not old enough over-simplified scenario, the less we can have nuanced conversations about it all. I suspect this whole move is purely an optics piece. That doesn't make it any less dangerous, in fact it maybe makes it more dangerous, but it explains the incompetence and lack of thought behind it.
- tomjen3 5y agoThing is it is not that difficult to lock down most porn sites if you are in control of the router and can force the use of a specific DNS. If you have your childrens iPhones as part of a family setup you can also block their access that way. However I salute you for your choice, which is the harder and better way. If more parents did as you, we would not have the issues we have today. Porn is nice enough but watch, but because there is essentially no discussion about how to have sex (outside of school, which at best is put tab a in slot b, here is how not to become pregnant, this is what STDs are.) the only input too many teens get is porn.
- hellbannedguy 5y agoI've wondered what is the best strategy is over the years. 1. Heavily restrict the porn/bad sites. or 2. Let them see the bowels of the internet, and hope they will go in the opposite direction.
- mixmastamyk 5y agoDepends on their age, I think.
- deleted 5y ago
- rabuse 5y agoI've had this problem recently with parsing a webpage using some webscraping library, and returning nothing since everyone seems to be running a SPA now. It's infuriating that you pretty much need to run some headless browser to just scrape a damn website now.
- beiller 5y agoDon't spas make scrapers easier cause you can just call the APIs directly?
- BenjiWiebe 5y agoYes, if your bot understands that particular website's API. If your bot only scrapes one website, that's great. If your bot needs to scrape 100's of SPAs all with their own homegrown APIs, have fun.
- beiller 5y agoI know that it is a different challenge reverse engineering a spa's APIs but you gotta admit, the existing system of XML / html parsing and websites making slight tweaks to their layout is the real nightmare.
- phist_mcgee 5y agoIt's been like this for years, google's own bots struggle to interpret a lot of sites without heavy manual intervention by the site developers.
- ve55 5y agoThe consequences of requiring government IDs for basic Internet usage are much worse than just making crawling and indexing more difficult. I worry that due to government/'activist' pressure and the difficulty of dealing with spam/bots/identity (think of the captcha/ML rat race we are in), we may end up with an Internet that is not only completely centralized (as ours is becoming), but that also completely disallows anonymous and pseudonymous usage in most cases. I'm definitely not a fan of the direction many government bodies are taking us with respect to this.
- Scoundreller 5y ago> think of the captcha/ML rat race we are in Google and my employer deal with massive amounts of spam emails and gets it right 99.9999999% of the time. There’s a reason why Google captcha me on their own properties. (It’s inexplicable why EBay captchas me AFTER I submit 2FA…) We know who the bots are, but if you want your visitors to do some free work for my training models, so be it. The captchas need some work though. If you want me to select all photos with carS, I’m not going to choose the photos with one car only.
- tomxor 5y ago> It’s inexplicable why EBay captchas me AFTER I submit 2FA… Google does this too and it drives me nuts. What's makes it even more of a "fuck you" is they will do it to paying users, (business accounts)... if you refresh the page three times the captcha goes away, they are just trying their luck at using people for free ML training labour.
- mandelbrotwurst 5y ago> The captchas need some work though. If you want me to select all photos with carS, I’m not going to choose the photos with one car only If you're trying to get through these while spending the least amount of time on them, you want to answer "How would most people presented with this answer the following: _______ ?" as opposed to "What do you think is the most correct answer to the following ________ ?"
- 5y ago
- Edmond 5y agoThe argument about crawling is not a good one, a simple authentication mechanism, for instance with asymmetric key cryptography can address that problem. Along those same lines, the internet can in fact have scalable information verification (age,height,income,sex...etc) with robust privacy: https://certisfy.com https://certisfy.com In other words, cryptographic certificates can solve this problem.
- Geee 5y agoBetter solution is to provide OS-level parental controls, so that parents can whitelist websites / apps / social contacts for their children. No age verifications or breaches of privacy needed for safer Internet.
- nitwit005 5y agoJust seems like a boon to intelligence agencies, as it provides a super convenient way to blackmail people. Intercept or steal ID information somehow, and threaten to release information on their porn watching behavior. There are already scam emails with this basic concept, such as falsely claiming to have video of you watching porn.
- drdavid 5y agoI get those emails. It's too bad the reply-to email address never works. I've tried a couple of times to let them know that it'd be hilarious if they shared my porn watching habits with my friends and family and that to explain that I'd like a copy of any of the videos they supposedly took of me. I don't present myself as something other than what I am. So, they can't really blackmail me. Life's easier when I don't do anything I'm ashamed of.
- joe_the_user 5y agoDoes anyone have a pointer to what bills are being considered where? It seems like it's Europe and probably the European commission but a bit of web search doesn't turn up anything.
- kazinator 5y agoAge verification won't kill searches because, doh, sites will make an exception for spiders. And of course, they will make an exception for big name spiders like Google, for instance by originating domain. Age verification will potentially create raise the entry barrier against competing with big search engines.
- scarby2 5y agothe point the author is making is that if you make that exception it may well become trivial for an underage user to pretend to be those spiders therefore bypassing the age protection. However if a user is smart enough to bypass those checks it's likely that the content they are blocking will not do them any harm (though equally i'm not sure i've seen research that suggests that exposure to adult content online is harmful specifically to those under 18) I have however seen plenty of research that suggests that social media is harmful to just about everyone, and we're not trying to block that
- kazinator 5y ago> it may well become trivial for an underage user to pretend to be those spiders therefore bypassing the age protection. I don't think so; forging a reverse DNS so your IP address looks like you're a spider connecting from google.com is not trivial. The other aspects of the connection can be easily faked, of course, but that means nothing if the site is validating on IP block or domain. (There will likely be trivial ways to defeat the age checks, just not by way of the route of successfully pretending to be the Google spider.)
- bouncycastle 5y agoThe age verification got me with Google recently. When I registered my google account in 2004, I didn't put my real info and wanted to stay "incognito", because even back then I was reluctant to be giving info to Google. It was just a search engine after all, why does a search engine need more info.. right? Now after 17 years, they are asking me to age-verify my account. So far I have refused, but I think eventually I'll be forced to cough it up. I have a feeling that it will probably start with birthday first, and then later expand to adding real name, address, and government issued ID.
- zarzavat 5y agoThe internet is fortunately not part of UK territory. Websites will just block UK IPs, if they do anything at all. People in the UK will use VPNs to access the content they want and the world will go on as normal.
- mjevans 5y agoID / verification is a solution in search of a problem. The OS level filters and parental controls exist, and have for years. Though a slight logical tweak or a slightly improved system might be more helpful. The Internet, by default, should be free and considered 'unsafe'. Sites and services that claim to be Safe for Children should have to actively tag themselves as such. That might involve metadata. It might involve third party organizations like commercial certificate providers signing that claim; or governments, or insurance program registrations, or groups dedicated to whatever moral police panic is in vogue, etc. Let people Opt In to creating locked down accounts that are nanny state and useless. Don't FORCE it on everyone.
- wumpus 5y agoThere already is a standard for declaring a website safe for children, and no one uses it. Also, the concept of what is "safe for children" differs between countries. One major way of oppressing LGBTQI+ people is to outlaw showing anything that promotes LGBTQI+ "lifestyles" to children.
- mjevans 5y agoYes, that standard is what I meant by "OS level features"; no one uses it because they'd rather foist the effort of protecting children to others. Though this is probably more because they dislike free speech and disagree with activities among adults and 'think of the children' is just what gets used to win support. Your second point is an interesting extension: 'safe for children, in all countries' would lead to a race to the most bland, safe, content: "baaaah" - 1984.
- wumpus 5y ago> no one uses it because they'd rather foist the effort of protecting children to others. There's no right way to "protect children" when some countries define any mention of LGBTQI+ to be unsafe for children. There is no way I, as a random website creator, can figure out the appropriate worldwide label for my content. Am I foisting "the effort of protecting children to others"? I don't think so.
- cunthorpe 5y agoAre bureaucrats really that blind to the concept of “foreign websites” that will continue existing without having to follow any of your rules? You ask Facebook to ID me, fine, but my-pretty-face.ws will continue existing unchecked and there’s nothing you can do unless you want to start blocking 80% of the internet. The solution is simple: Move the damn check to the device or network. Block content at schools and lock down your own children’s devices.