4 ms·
Well, I wasn't taking the OP's idea to mean only splitting off the crawler. Why not an API where you send it the search query and then it returns the results? I
by technotarek 6y ago
Well, I wasn't taking the OP's idea to mean only splitting off the crawler. Why not an API where you send it the search query and then it returns the results? It could have a variety of return options including using a ranking of the API publisher's choosing or you could ask for something raw, and innovate with an even better or more suitable ranking based on your specific needs.
In the end, the point would be to make Google closer to what it was at the beginning -- just input and output. No ads on top of it, no bundling with other offerings etc. And if the publisher's ranking remains as good as it should, then surely some will be willing to pay not only for the raw data, but the ranking as well.
- visarga 6y agoThis is exactly how I envisioned it. A crawl+index company that gives equal access to all competitors. The search front companies would use the index to retrieve pages, then they would rank these pages with their own criteria and filter with their own white/black lists, then present the result in their own UI. Each one would have their own ads and tracking (or lack thereof). The index would not be able to know the identities of the users. In the end they all boil down to an "attention economy", it's about us and our eyeballs, we should have more say on what we are consuming. The part about ranking, filtering, tracking and UI is true for FaceBook and Twitter as well, even though they are a different kind of service. We could have alternative views on these systems, where we have more control on the way the system manipulates the information for us.