There doesn't seem to be any evidence that it's used for indexing at all; it seems more like it's just used to scrape additional info from sites that they index

There doesn't seem to be any evidence that it's used for indexing at all; it seems more like it's just used to scrape additional info from sites that they index via real search engines like Bing, Yandex, and Yahoo. https://news.ycombinator.com/item?id=4851680 https://news.ycombinator.com/item?id=4851680