43 ms·

While hiring a ton of people to fact-check would be one solution, that obviously wouldn't be very scalable. I think the problem lies in google's algorithm. They

• radicsge 10y ago
  I feel referring to (or hiding behind) scalability is a bit salt in the wound. These huge companies are destroying so many jobs (by scalability) - ok unavoidable - but they should do sometimes things that are not scalable and give jobs back to people in trouble. Im not sure how long they should be allowed to go away with it. [just dreaming...]
  • blowski 10y ago
    I agree with your sentiment. Google is abusing its position of market leader to dominate other markets which it's not very good at, which results in providers that _are_ good at those markets going out of business. If Google wants to make money by being the endpoint for every question ever asked, they need to accept the consequences when they get the answers wrong.
• tbrowbdidnso 10y ago
  I'm no wizard, but in writing blog articles I've found ways to fool Google into believing me. The problem with their algorithms.... is that all that statistics in the world can't help you when you're listening to a guy telling the truth vs an equally good liar. I can tell you what Google doesn't have, a strong AI. It thinks it knows "facts" but these are merely patterns, and these can be gamed. Because Google still lacks a strong, truly thinking AI, they rely extremely heavily on statistical models to rate content. So how do you cheat google search? Google's systems attempt to figure out the topic of your writing, the style, and quality. Is it scientific? An opinion piece? News? Is it a technical topic? A playful one? Fiction or nonfiction ? The quality classifiers are much easier to game than topic and style analysis. They determine things like reading level of text but also things like the number of rare nouns, number of technical words, number of typos. Readability as far as font and formatting. Trustworthy signal of your domain and possibly the company and people they determine to be linked with it. I also have a feeling google uses sneakier signals as well. These include your DNS registrar, phone number, email, and address listed on the site. Who you host with and what technologies you're using. Your mail servers and how trustworthy they are. Geo location, and visitor traffic info as soon as you put analytics on the site (or use amp) Basically when Google says they have tons of signals, they do. They have a dataset that amounts to every site on the internet for the past 15 years, and they regularly run automated and manual "theory provers" much like quants do with historical stock market data. They find new signals constantly, and run tests to see if their new algorithms are better. You know how sometimes google randomly takes a bit longer to load search results? My tin foily theory? They'll occasionally guinea pig you on prototype search results to see if they're better. I noticed their response time getting really bad a couple months before the public rollout of new AI powered search for example. So gaming google? Do exactly everything that a large, legitimate, no-nonsense company would do. From where you host, what you host with, to who you link to. Bonus points if you have significant real looking mail and other traffic from your domain. Extra bonus points if you actually sell something real as cover and do it for at least a few years. Once you've done enough convince google you're a big important thing IRL...write a ton of really subversive bullshit. Make it sound a real as possible, hell make 90% of it real, just with a single unverifiable fact. Keep pumping this shit out and make sure your garbage is never fake enough to get called out on. Or just make the fake part so hard to verify that nobody will waste the time, kinda like half the science world does when publishing papers.
  • jwl 10y ago
    Gaming Googles image search is a popular activity on some subreddits. Basically telling people to upvote a picture of something with a misleading title. Like if you search for images of "gaming console", a picture of a potato will appear. It is very clear that their "AI" is not that clever yet.
  • danmaz74 10y ago
    > I can tell you what Google doesn't have, a strong AI Did anybody think the contrary?
    • tbrowbdidnso 10y ago
      If anyone had one it would be Google :)
      • danmaz74 10y ago
        Fact is, nobody is even near having one ;)
        • bigbugbag 10y ago
          Fact is no one wants a strong AI, skynet leading to matrix future is not that desireable. On the other hand soft AIs are everywhere and replacing humans in many jobs.
          • ceejayoz 10y ago
            > Fact is no one wants a strong AI, skynet leading to matrix future is not that desireable. I want a strong AI, because I'm more a fan of the depictions along the lines of Iain Banks' post-scarcity Culture Minds.
  • malisper 10y ago
    > The problem with their algorithms.... is that all that statistics in the world can't help you when you're listening to a guy telling the truth vs an equally good liar. While that's true for sites in isolation, Google published a paper a few years ago[0] that describes how you could estimate the trustworthiness of a website. The basic idea is you assign a trustworthiness score to each website. Then, you determine how likely a fact is to be true based on the trustworthiness of the sites that state that fact. You can then recalculate the trustworthiness of each site based on whether it agreed with the fact or not. [0] https://arxiv.org/pdf/1502.03519v1.pdf https://arxiv.org/pdf/1502.03519v1.pdf
• abandonliberty 10y ago
  Metrics are destroying the web. Once upon a time it was possible to identify "good" pages by how often they were linked - effectively crowd-sourcing the problem. Natural selection: sites have learned to manipulate the game and the crowd. Under pressure to optimize metrics that lead to SEO and better valuations, the internet is getting less useful from a user perspective. I don't want to watch a video/slideshow, download an app, register for a forum, or read through a 2000 word fluff piece with interspersed ads and links to more information in which site has buried the one-sentence answer to a 2-second question in order to maximize my time on the site. This garbage is what makes it to the front page of google these days. I guess the poor sites that aren't user hostile just aren't SEO'd enough.
  • 65827 10y ago
    Metrics are destroying lots of departments in lots of companies. Everyone seems to fixate on the analytics for this week or maybe this quarter, there is little or no attempt to understand the why or think long term. So many companies have cut back severely on the sorts of risky investments they used to make regularly, because the data is being conflated with reality
  • throwaway2048 10y ago
    A good example of this is mailing list archives. Pages and pages of google links searching for mailing list posts are filled with maximum ad-cram (often dressed up like a fake forum) garbage, meanwhile the clean, no bullshit mailing list achive everyone links to (marc.info) is nowhere to be found at all. This is likely because marc.info isn't playing the SEO game, and spamsite #43254 is.
  • gregmac 10y ago
    What's strange is this is not at all a new problem, and Google has historically been quite good at fighting it. The original search engines ranked pages by their content. Naturally this led to gaming by including keywords (remember huge invisible sections of pages that just repeated keywords thousands of times?). Google's original PageRank algorithm was a complete breakthrough for this, almost completely disregarding content and instead ranking results based on the text other pages had used to link to the page. This was so good, in fact, that most of the other search engines from the time didn't survive. This once again led to large-scale gaming with techniques like link farms, and a small arms race as Google came up with ways to squash these new techniques. The quasi-legitimate "SEO" industry spun out of this. I think now we're in the same cycle again, and at this moment scam sites are winning. What's to be seen is if there's a looming breakthrough, or the arms race will continue.
• hobofan 10y ago
  > will hinder their ability to be a source for gaining knowledge CAUTION: subjective experience ahead I feel like in the last few years Google's utility for knowledge discovery has decreased. Instead it seems to be geard more and more to drive you towards purchase and shallow content sites. I think the growing popularity of "awesome" lists and other forms of curated content discovery is also driven in part by Google's lack of "good content" discovery.
  • bigbugbag 10y ago
    Google stopped providing relevant search results more than 10 years ago. It used to be several pages of relevant search results, now you are lucky if you have more than 2 or 3 somewhat related results in the first page and that's about it. You can tell there was a paradigm shift at some point and the search engine became a second (third? fourth?) class citizen.
    • ccozan 10y ago
      Actually google has become ( for me, at least) lately some kind of proxy to stackoverflow and wikipedia, since both this two services have atrocious own search solutions and I have to rely on google to get interpret my keywords the right way.
      • cdubzzz 10y ago
        This really does seem like a big problem. What are some sites that do site search well? Is there currently a good way to implement something even half as good as Google locally without a major lift?
        • ccozan 10y ago
          I was senior engineer with Autonomy ( before being bought by HP ) and we did really good projects for some big companies, it worked well. Lucene comes a long way, with enough time, some cool stuff would emerge. But if you need to replicate google, you need bootloads of user data and in generally data to operate on ( i.e. to be able to extract the equivalence of certain terms and expressions, and so on ). And generally some kind of feedback system ( like user clicking a link on a SERP, is adding that question/answer combo a certain boost for the future ). In short: it's complicated and after 10 years of experience I couldn't tell if a solution is so unversal as google.
• Vinnl 10y ago
  A whitelist is sure to get them anti-competitiveness suits, and rightly so.
  • marcosdumay 10y ago
    What is the difference between a whitelist and an algorithm with unknown but discoverable biases?
    • Vinnl 10y ago
      They're both undesirable, but a whitelist is easier to fight.
• NoGravitas 10y ago
  > What's weirder to me is that it seemed like they were going with my proposed route for a pretty long time and only recently starting providing dopey answers. I feel like the article addresses this. Google has basically two different products that produce those top of the page, set-aside answers. One is "Knowledge Graph", which basically does what you are suggesting - grabs straightforward answers to simple questions from Wikipedia and similar. The second is "featured snippets", which is the one causing the outrages that the article highlights.