4 ms·
We’re moving even further to the end for scraping the entire web and pagerank. It’s been on a steady decline for a long time with dark SEO and filler content p
by nzoschke 4y ago
We’re moving even further to the end for scraping the entire web and pagerank.
It’s been on a steady decline for a long time with dark SEO and filler content patterns.
Google already tries to just give you the right answer to your question and not send you to garbage websites.
Someday we’ll seldom need to read any websites directly, especially for anything that content marketing and think pieces are trying to answer.
If you want that, chat with the AI to ask questions and get answers directly. Ask more questions to get more angles of thought.
This is a good thing IMHO. People using AI to fill their websites with content is a waste of everyone’s time.
The big question is where does all the training data come from if not from scraping the whole web.
We will figure out some sort of provenance system for data, which will lend to the high quality data sets of human curated knowledge and art.
These will have trade offs, like limits to the knowledge and more expensive to build and consume. This will compete with data sets that do scrape everything.
What’s ironic is we’re shifting back to the days of Yahoo curating a directory of content, which Google ultimately destroyed with their crawling and ranking.
Everything is cyclical.
- cheschire 4y agoDid you mean "scrapping" in your first sentence? I am a bit confused since "scraping" is something that search engines do, but pagerank is something that you might want scrapped instead of scraped.
- anilakar 4y ago> Google already tries to just give you the right answer to your question and not send you to garbage websites. Funny, because every goddamn time I try to find a solution to a very specific issue, the first page is full of sites that repost AI-mangled crap that tells you to keep your computer and firewall updated. Hoating that hot garbage ought to be punishable.
- skissane 4y agoI search for the name of a Windows DLL, because I want technical information about it – what it does, its documented API, any information on undocumented APIs or reverse engineering, its implementation status in Wine or ReactOS, history of security vulnerabilities, its history (is it a descendant of some DLL in Windows 3.x, or was it just added in Windows 10 or 11?), etc, etc, etc Instead of giving me what I want, it gives me pages of useless content farm crap with titles such as "How to Fix WHATEVER.dll Not Found or Missing Errors", "WHATEVER.dll free download", etc, etc, etc. I can't understand why Google can't expunge all this content farm junk. I don't believe it is technically infeasible – rather, I think it is that Google (for whatever reason) doesn't actually want to do so.
- nzoschke 4y agoGoogles business is to sell your eyeballs to advertisers. If you click on one of those junk pages you’ll likely get more ads. Not good business to send you directly to the ad free reference site with all the answers.
- altairprime 4y agoPagerank only worked in the beginning because the human curation of early journal sites and webrings provided a clean training set. Pagerank is a parasite openly committed to dehumanizing knowledge, that ended up killing its human hosts, and is now itself dying. That’s not ironic, that’s ecology.
- nzoschke 4y agoNailed it. Time to watch the ecological cycle play out again. If i had to bet, Google won’t survive. Someone much smaller and nimble will take over.
- wankle 4y agoMobile was supposed to have killed off PC's by now. Music videos were supposed to kill off radio. I don't want search engines or web sites to go away and I don't believe they will. The recent AI fad is quickly being realized as another tool, sometimes useful, sometimes out in left field, on another planet, that doesn't exist.
- nzoschke 4y agoIf killed off means 0 that will never happen. But surely mobile dominates desktops worldwide now. Most things are mobile first or mobile only.
- nzoschke 4y agoAlso we will see a similar cycle play out with AI that computing devices did. Right now we back in the “mainframe” days where IBM, MS, and Google have the systems. Next will be “super computers”, then “work stations”, then “personal computers” then “mobile”. At the end we’ll all have many data sets and AIs in our pocket. This cycle will be way faster because we don’t have to invent the underlying computer tech. You can already get the AI in your pocket to classify and content search all you photos.
- wankle 4y agoWe'd need to better define dominates. Does it mean, lots of mobile devices compares to PC numbers? Probably. Which do most computing users spend the most time on, PC or mobile during the course of a day. I think the answer has to be PC (Linux, Mac, Windows, etc.).
- nzoschke 4y agoBut provenance will not be block chain and NFTs… More like a shift back to universities producing, curating and verifying the highest quality human produced data.