4 ms·

Soon, there will be an LLM that can utilize indexes and large scale distributed databases, and that will replace every search engine on earth. Google should be

Soon, there will be an LLM that can utilize indexes and large scale distributed databases, and that will replace every search engine on earth. Google should be quaking, and pissing themselves. It won't be their bardum, and they won't have the financial power to purchase said LLM. Poof. Goodbye useless SEO spam, advertisement hell. We hated your guts.

gnicholas 3y ago
> Goodbye useless SEO spam You think LLMs won't also be used to generate more SEO spam? I think this will be an arms race, or a game of LLM-cat and LLM-mouse.
computator 3y ago
> Goodbye useless SEO spam, advertisement hell. We hated your guts. That sounds great, but are you sure that there won't be legions of LLMs generating SEO spam and advertisement hell in warfare with the LLMs that do search? Just as an aside: Sci-fi seems to have one superintelligence (one Skynet) fighting humankind. If superintelligence emerges, I think it's likely that we'll have thousands, millions, or billions of superintelligences fighting each other, each with its own agenda.
- andirk 3y ago
  The searching of data doesn't need to be controlled by insanely powerful insanely rich entities. Ex: Wikipedia, Craigslist, polio vaccine. If this LLM arms race leads to an organic solution that anyone can grow their own, it might not have as many "This 1 Trick Your Grocer Doesn't Want You To Know" ads in it. And for superintelligence, let's clarify that this "Artificial Intelligence" moniker has almost nothing to do with actual intelligence, so we're probably a few years off from that.
Yemeth 3y ago
I'm not sure how LLMs are going to be immune to SEO spam and advertising. As if human nature would magically transform and people would stop buying stupid stuff. LLMs are already being used to make the web even less useful, by shitting out vast ammounts of meaningless and even outright wrong text for SEO purposes. And don't forget the systems are being trained on the web in the first place… using a LLM that is able to utilize a web search already thinks listicles are useful information and not just a way to place affiliate links. When the hype is over and the VC money dried out, companies will find ways to make the LLM interfaces and outputs an 'advertising friendly' affair.
- winwang 3y ago
  I think the idea is that, if we (some of us) can figure out when something is SEO spam or rather, generally low quality, an LLM should be able to but faster and more quantitatively why.
  - tempodox 3y ago
    And who, pray tell, would have an interest in giving us that? The internet overlords are advertising companies. Would you pay for such an LLM? Those companies have gotten so powerful because everyone wants stuff for “free”.
    - Terretta 3y ago
      > Those companies have gotten so powerful because everyone wants stuff for “free”. On the contrary, my experience of the Internet since pre-web is those companies have gotten so powerful because now everyone 'creating content' wants to get paid. Put another way, the gwerns of the world may start by posting ad-free content just because they feel like sharing. "Those" companies can't profit from individual pamphleteering. But usually, as soon as a gwern has a measurable readership, they imagine money, and start supporting the ad industry. Surprisingly quickly, chasing more ad revenue becomes the point of their content instead of just sharing whatever they had to say. Today, it seems most people start by wanting to get paid, and come up with a type of content to create. Curiously, and as a result of the type of targeted searching gwern describes here, you'll generally find the best content is that which is still published free (self hosted or as open papers) thanks to motivations of the content's creator.

gnicholas 3y ago

> Goodbye useless SEO spam You think LLMs won't also be used to generate more SEO spam? I think this will be an arms race, or a game of LLM-cat and LLM-mouse.

computator 3y ago

> Goodbye useless SEO spam, advertisement hell. We hated your guts. That sounds great, but are you sure that there won't be legions of LLMs generating SEO spam and advertisement hell in warfare with the LLMs that do search? Just as an aside: Sci-fi seems to have one superintelligence (one Skynet) fighting humankind. If superintelligence emerges, I think it's likely that we'll have thousands, millions, or billions of superintelligences fighting each other, each with its own agenda.

andirk 3y ago
The searching of data doesn't need to be controlled by insanely powerful insanely rich entities. Ex: Wikipedia, Craigslist, polio vaccine. If this LLM arms race leads to an organic solution that anyone can grow their own, it might not have as many "This 1 Trick Your Grocer Doesn't Want You To Know" ads in it. And for superintelligence, let's clarify that this "Artificial Intelligence" moniker has almost nothing to do with actual intelligence, so we're probably a few years off from that.

Yemeth 3y ago

I'm not sure how LLMs are going to be immune to SEO spam and advertising. As if human nature would magically transform and people would stop buying stupid stuff. LLMs are already being used to make the web even less useful, by shitting out vast ammounts of meaningless and even outright wrong text for SEO purposes. And don't forget the systems are being trained on the web in the first place… using a LLM that is able to utilize a web search already thinks listicles are useful information and not just a way to place affiliate links. When the hype is over and the VC money dried out, companies will find ways to make the LLM interfaces and outputs an 'advertising friendly' affair.

winwang 3y ago
I think the idea is that, if we (some of us) can figure out when something is SEO spam or rather, generally low quality, an LLM should be able to but faster and more quantitatively why.
- tempodox 3y ago
  And who, pray tell, would have an interest in giving us that? The internet overlords are advertising companies. Would you pay for such an LLM? Those companies have gotten so powerful because everyone wants stuff for “free”.
  - Terretta 3y ago
    > Those companies have gotten so powerful because everyone wants stuff for “free”. On the contrary, my experience of the Internet since pre-web is those companies have gotten so powerful because now everyone 'creating content' wants to get paid. Put another way, the gwerns of the world may start by posting ad-free content just because they feel like sharing. "Those" companies can't profit from individual pamphleteering. But usually, as soon as a gwern has a measurable readership, they imagine money, and start supporting the ad industry. Surprisingly quickly, chasing more ad revenue becomes the point of their content instead of just sharing whatever they had to say. Today, it seems most people start by wanting to get paid, and come up with a type of content to create. Curiously, and as a result of the type of targeted searching gwern describes here, you'll generally find the best content is that which is still published free (self hosted or as open papers) thanks to motivations of the content's creator.