This may not be exactly what you’re asking about: in my mind, a realistic and practical solution is to have large language models do the search, look up many of

This may not be exactly what you’re asking about: in my mind, a realistic and practical solution is to have large language models do the search, look up many of the top hits, avoiding the advertisements and clear SEO, and then report back with any actual hits for your personalized search. Indexing the web is not that hard if you don’t have to give a perfect solution as the first answer because there is an LLM that can do the selection at a second stage. Furthermore, a lot of the trivial search is not a search for new things but a knowledge lookup for which there are also better solutions once you can combine LLM in the mix.