3 ms·
Thanks - yes we don't have local searches working well yet and it is very US-centric for those there are there. The password information is interesting. In the
by jedwhite 5y ago
Thanks - yes we don't have local searches working well yet and it is very US-centric for those there are there.
The password information is interesting. In the old world, you'd find out it is now password protected only when you go there. Because Andi grabs content live from the source, you can see they've changed it right there in the search results. I'm guessing the page must have been open before, and now it's password protected (or they let robots.txt in but not user agents).
Andi is retrieving content to show in results via anonymous proxies. So the search results page reflects what is on the live site (so long as we can grab the latest content).
Thanks for trying out Andi and interesting edge case! I think the best thing to do will be filter pages out of the live results page on the fly if it turns out it's been password protected very recently when a user sees the results.