4 ms·
A use of LLMs by search engines that I would like to see applied: # At indexing time - The search engine use LLM to convert all the page content into a "common
by fbn79 2y ago
A use of LLMs by search engines that I would like to see applied:
# At indexing time
- The search engine use LLM to convert all the page content into a "common language" (English?!) before indexing.
- Use LLM to rank the page (detect page spammy/informational level)
# At query time
- My query is translated to the "common language"
- Result list most appropriate results unbiased by page language, but only by spammy/informational value.
- freeone3000 2y ago1 and 3 are done. (2) cannot be done practically by any dominant search engine because, no joke, the spam site owners get mad.
- Thorrez 2y agoIs this comment on the wrong article?
- fbn79 2y agoYes, was about this https://news.ycombinator.com/item?id=42114990 https://news.ycombinator.com/item?id=42114990 . I don't know we ended up here! sorry!
- hiatus 2y agoWhy would you like to see these things? It seems undesirable to return results in a language the querier does not understand.
- fbn79 2y agoIt depends. Let's suppose we want to search info about the bio of historic people, for example Julius Caesar. Google will return for sure the link to english wikipedia. But let's assume that Italian Wikipedia got more deep info about Caesar. Would you prefer to see a less complete English version, or get the most complete Italian version (and auto-translate it in English with any available tools to read it)?