3 ms·

I'm surprised that a search engine that isn't powered by AI is able to raise money. From the direction things seem to be going, LLM tech may very well level tha

I'm surprised that a search engine that isn't powered by AI is able to raise money. From the direction things seem to be going, LLM tech may very well level that entire industry.

qqtt 3y ago
How do you think "LLM tech" discovers content to train it's massive models?
- deleted 3y ago
  [deleted]
starbugs 3y ago
That's likely true for search queries that can be phrased as or somehow represent a question (that can be answered with the information contained in the training data, usually limited to 2021 atm). For all others, probably not so much. Try GPT4's web plugin. It's not a pleasant experience. There's a gap in the market for a search engine whose incentive structure doesn't cause it to become corrupted.
Veen 3y ago
Kagi has lots of LLM-based features: Quick Answers in results, results summaries, Ask Questions About This Document, the Universal Summarizer[0], FastGPT[1]. - [0]: https://kagi.com/summarizer/index.html https://kagi.com/summarizer/index.html - [1]: https://labs.kagi.com/fastgpt https://labs.kagi.com/fastgpt
sunnybeetroot 3y ago
They do have AI features.
marginalia_nu 3y ago
LLMs are a great new interaction paradigm for interrogating a corpus of documents, but not such a good way of finding which documents to interrogate (and unless you do, it's not all too useful for information retrieval). The real magic happens when you stick the two together. Let traditional search find the relevant documents, and then interact with them through a LLM. This isn't a shortcoming in model tuning or context window size. The way I see it, recent AI improvements make the future brighter for new search engines. In a gold rush, there are two types of winners, you can win by beating the rest to the gold, or you can win by being the guy selling maps and pickaxes. Traditional search indices fall squarely in the second camp. AI actually opens new avenues for profit for traditional search, since while it's notoriously difficult to monetize an internet search engine, suddenly you can make ends meet selling API access to AI start-ups.
adultSwim 3y ago
It aggregates search results from engines that are powered by AI. Google creates a BERT embeddings of indexed pages.

I'm surprised that a search engine that isn't powered by AI is able to raise money. From the direction things seem to be going, LLM tech may very well level that entire industry.

qqtt 3y ago

How do you think "LLM tech" discovers content to train it's massive models?

deleted 3y ago
[deleted]

starbugs 3y ago

That's likely true for search queries that can be phrased as or somehow represent a question (that can be answered with the information contained in the training data, usually limited to 2021 atm). For all others, probably not so much. Try GPT4's web plugin. It's not a pleasant experience. There's a gap in the market for a search engine whose incentive structure doesn't cause it to become corrupted.

Veen 3y ago

Kagi has lots of LLM-based features: Quick Answers in results, results summaries, Ask Questions About This Document, the Universal Summarizer[0], FastGPT[1]. - [0]: https://kagi.com/summarizer/index.html https://kagi.com/summarizer/index.html - [1]: https://labs.kagi.com/fastgpt https://labs.kagi.com/fastgpt

sunnybeetroot 3y ago

They do have AI features.

marginalia_nu 3y ago

LLMs are a great new interaction paradigm for interrogating a corpus of documents, but not such a good way of finding which documents to interrogate (and unless you do, it's not all too useful for information retrieval). The real magic happens when you stick the two together. Let traditional search find the relevant documents, and then interact with them through a LLM. This isn't a shortcoming in model tuning or context window size. The way I see it, recent AI improvements make the future brighter for new search engines. In a gold rush, there are two types of winners, you can win by beating the rest to the gold, or you can win by being the guy selling maps and pickaxes. Traditional search indices fall squarely in the second camp. AI actually opens new avenues for profit for traditional search, since while it's notoriously difficult to monetize an internet search engine, suddenly you can make ends meet selling API access to AI start-ups.

adultSwim 3y ago

It aggregates search results from engines that are powered by AI. Google creates a BERT embeddings of indexed pages.