5 ms·
I built my search engine in part to explore whether this was actually true, and I don't think it actually is. There's still a lot of organic human-made content
by marginalia_nu 5y ago
I built my search engine in part to explore whether this was actually true, and I don't think it actually is.
There's still a lot of organic human-made content still out there, possibly more than ever, it's just not able to compete with the SEO industry that completely displaces it from Google and social media.
- fifticon 5y agoI second that independent sites exist - I maintain my own website on a personally run server. There are dozens of us! to quote a quaint phrase.
- api 5y agoAll open systems are destroyed by spam once they become popular enough to be profitable targets. This will eventually happen to the Fediverse too. If there is money to be made pissing all over the commons, the commons will be pissed all over. It even happens to proprietary silos if they are too open. Look at how many bots and spammers infest social media. Propaganda and disinformation can also be considered a form of spam. I realize this sounds cynical but don’t shoot the messenger. It’s just something I’ve learned watching the Internet evolve since the middle 1990s. Spam eats everything it can. IMHO the future is enclaves and invite only communities. The Internet is a dark forest.
- marginalia_nu 5y agoAs old open systems are destroyed, new ones are created to replace them. The Internet exists in a constant state of rebirth and transformation. You really can't step into the same river twice.
- nonrandomstring 5y ago> You really can't step into the same river twice. I love the maxim and philosophy of eternal refreshment. Seems like the problem is more akin to having nuclear waste dumped into our rivers though.
- pixl97 5y agoIt's not cynical, is how every system in nature works. Everything alive must develop an immune system or it is attacked and eaten.
- NoGravitas 5y agoYou are probably right about the future; not necessarily because of spam, though that's a part of it, but just because of the toxicity of global, open to the world, mostly public social media. The Fediverse has mostly coasted by so far on obscurity, but it's not great, and it's bound to get worse. All of my online socializing these days is either through short-lived pseuds on topic-oriented fora, or invite-only Matrix rooms.
- pwdisswordfish9 5y ago> This will eventually happen to the Fediverse too. Oh, don’t worry, the Fediverse will never catch on.
- ffhhj 5y agoWhy? Serious question.
- indigochill 5y agoHow do you surface organic human content? I happen to linger around the fediverse/tildeverse sphere where I see organic content from people I personally have a direct (digital) connection to (and I started self-hosting my music after Epic bought Bandcamp), but I'm not clear on how I'd go about digging that kind of stuff up in the more general case.
- pixl97 5y agoWelcome to the billion dollar question. Any place that is authentic will face the zombie horde attempting to fake authenticity in order to capture attention.
- tomxor 5y agoI think your almost right, but it's not necessarily authenticity... I think it's just money. Large "authentic" search engines can exist to serve the rest of the web, those personal blogs and other small communities. Those sites have a natural tendency to not be trying to turn everything into a revenue stream, so if that was the prerequisite for an engine, it would be a perfect match and naturally dissuade marketing types.
- pixl97 5y agoAuthenticity is worth money. When you have a 'real' community you're talking about real people with real salaries and desires, add in that you tend to develop a real trust between members. Think of this as fertilized soil. You can grow crops in it, but weed seeds will eventually land and try to take over it. HackerNews is a good example of this, it takes a healthy amount of moderation to keep things on topic where things like politics get peared pretty ruthlessly. If for a minute Dang gave in found ways to additionally monetize the forums, something that would be profitable for a while at least, things would start down a bad path.
- marginalia_nu 5y agoI do a traditional web crawl and exclude anything that looks too much like it wants a high google ranking. Nothing to it.
- alxlaz 5y agoThis matches my findings 100%. The WWW is active and bubbling, but virtually all the cool websites I've found in the last 10 years or so came through friends, small IRC channels, or more recently through marginalia.nu :-). Google and friends are facilitators for the SEO and tracking industries, so of course they have zero interest to prioritize these things over content spam -- their whole business runs on content spam. But the WWW is as alive as it gets.
- sdoering 5y agoI can only agree with my sister comment. I find this industrialized web more and more shallow and taxing to use. While professionally I need to help (smaller, local) clients to reach their audiences I become more and more weary. It is like walking through a supermarket with industrialized fast convenience food shouting in bright colors and advertising while ultimately not nourishing me like slow, real food could. I am still looking for this digital slow food movement.
- nonrandomstring 5y ago> I am still looking for this digital slow food movement. https://digitalvegan.net https://digitalvegan.net Please read it, and if you enjoy it please suggest it to friends.
- lovskogen 4y agoRead the intro. So you find vegans annoying (because they 'are the future'), and your not a vegan yourself – and you write that digital veganism is more important than actual veganism. Now that's a way to start off well!
- ColinHayhurst 5y agoAgreed. > If I want to search for something topical and relevant, I go to Facebook, Twitter, Reddit, HackerNews, Instagram, Google Maps, Discord etc. The general Internet is dead: it's just legacy content and spam. The "general" Internet is not dead. Though if you just want to participate in just Facebook, Twitter, Reddit, HackerNews, Instagram, Google Maps, Discord you might well think that. Users of marginalia (author above), Mojeek (disclosure: CEO) and others [0] are well aware that there are riches of organic human-made content; from years back and new. Yes, a lot of noise too, which Google has a bigger (SEO) struggle to compete against. But still there is good and different content available. To find good content, using search, you need to use "search" engines which enable discovery, as Google used to do so. I stress the "search" as the emphasis of Google, Bing and thus their syndicates is increasingly on being "answer" engines. [0] https://seirdy.one/2021/03/10/search-engines-with-own-indexes.html https://seirdy.one/2021/03/10/search-engines-with-own-indexe...
- mc32 5y agoSounds like we’re back to AskJeeves and a number of failed answer engines from a couple of decades ago!
- ColinHayhurst 5y agoAskBERT but now MUM knows best.
- tmaly 5y agoEveryone is trying to game the Google algorithm. The net result is all this long form content and cooking recipes that are 10 pages long. There seems to be a big disconnect with a typical users attention span and the length of a post.
- ajmurmann 5y agoI thought the recipe thing was to be able to copyright them
- pmontra 5y agoI take myself as an example. People that know me and don't meet me regularly might know the URL of my web site and might care to look at it once per year and check if there is something new. Usually pictures and tales from holidays. Covid made those holidays less memorable so I didn't make any update since fall 2019. People that meet me regularly don't need that website, I'm telling them the tales first hand and showing them the pictures without being obnoxious. I guess that this website is a target for your search engine except it's not in English and your search engine seems to want English search phrases. I don't have anything of value to share on a public chat like Twitter and I don't have an ego to pretend I do. I also don't use Facebook anymore. I go there once per year to like the messages that wish me happy birthday. I think it's polite to do so. All my media production is on WhatsApp or Telegram in group chats with people I know in real life. If I really cared about producing content for the world I'd probably be using Twitter, Medium or the fad of the year and they'd take care of my SEO (do they?) or I'd be trying to score points on StackOverflow. To recap: I never intended to compete on SEO. I'm really OK that my website is only for friends and spreads by word of mouth. It probably never did, I bet it's been on a flatline since I created it 20+ years ago.
- dylan604 5y agoAnd who uses your search? I had never heard of "you" until just now. And there is the problem with "new" search engines. Unless you can come up with what would have to be one of the greatest ad campaigns the world has ever seen, no significant number of users will know you exist. Where does the money to pay for that ad campaign come from? How will a search engine generate money to stay relevant? Once people see you becoming relevant, they will figure out how to game your system. It's just the nature of the beast. I don't think I'm being overly cynical about this either.
- marginalia_nu 5y agoWhy would I need to generate money to stay relevant?
- dylan604 5y ago<edit>The first </edit>relevant was the wrong word. sustainable would be more appropriate. on the assumption that hosting the search engine isn't free, and unless it is supported by a generous benefactor it will need to have a way of generating money to keep the servers running.
- marginalia_nu 5y agoI'm self hosting so my operational cost is like $50/mo.
- throwaway14356 5y agothen he must be relevant
- kodah 5y agoAgreed, the general internet is not dead, but the majority of internet users are on Facebook, Twitter, Reddit, HackerNews, Instagram, Google Maps, Discord etc. From my perspective, we onboarded a lot (if not most) people to the internet after 2007 (the explosion of social media). People sticking to big sites really speaks to an inability to explore the larger internet and a lack of knowing why you would even want to.
- kthejoker2 5y agoI think the answer is in the name: "social" media. Most (99%) people use the Internet most (99%) of the time to see or hear what other people are up to. The big sites are where all the other people are. QED. (This comment falls into that space)
- Vladimof 5y agoI added it to my list of search engines on Firefox... your favicon is really small, that's on purpose?