3 ms·

Just curious. Wasn't Yahoo using Google and Bing for search? Is this crawler being used at Yahoo internally?

cbsmith 11y ago
Remember, Yahoo acquired Inktomi, and effectively AltaVista & AllTheWeb.
peterhadlaw 11y ago
If I recall correctly, Yahoo had a couple other offerings / search tools. They had something called YQL which you enabled you to treat a specific, public (supported) websites, like Craigslist for example, as a SQL table. SELECT * from <house_for_rent> etc, etc, etc. I have no idea if this is what was used here but I know this is an example where I'm sure they didn't out source the search work to Google.
hankin 11y ago
It looks like Wikipedia agrees with you- Originally, "Yahoo Search" referred to a Yahoo-provided interface that sent queries to a searchable index of pages supplemented with its directory of websites. The results were presented to the user under the Yahoo! brand. Originally, none of the actual web crawling and data housing was done by Yahoo! itself. In 2001, the searchable index was powered by Inktomi and later was powered by Google until 2004, when Yahoo! Search became independent. On July 29, 2009, Microsoft and Yahoo! announced a deal in which Bing would henceforth power Yahoo! Search.[4] I have no idea if this is still the case.
trifecta16 11y ago
You are correct. Formerly, Yahoo used it's own spider that was Slurp!. Currently, Yahoo is using Bing to power is search results. Yahoo has granted that Bing will grant the majority of it's search results. They have just struck a deal with Google, to start including Google search results in it as well. In the future, we should see 51% Bing results and 49% Google results.
rasz_pl 11y ago
Once upon a time in a land long forgotten, before being a holding company for Alibaba investment, Yahoo was actually doing interesting stuff. You could say Yahoo was Google before Google was Google. They did things like Yahoo webpage hyperlink connectivity graph, and tons of other research.

Remember, Yahoo acquired Inktomi, and effectively AltaVista & AllTheWeb.

If I recall correctly, Yahoo had a couple other offerings / search tools. They had something called YQL which you enabled you to treat a specific, public (supported) websites, like Craigslist for example, as a SQL table. SELECT * from <house_for_rent> etc, etc, etc. I have no idea if this is what was used here but I know this is an example where I'm sure they didn't out source the search work to Google.

hankin 11y ago

It looks like Wikipedia agrees with you- Originally, "Yahoo Search" referred to a Yahoo-provided interface that sent queries to a searchable index of pages supplemented with its directory of websites. The results were presented to the user under the Yahoo! brand. Originally, none of the actual web crawling and data housing was done by Yahoo! itself. In 2001, the searchable index was powered by Inktomi and later was powered by Google until 2004, when Yahoo! Search became independent. On July 29, 2009, Microsoft and Yahoo! announced a deal in which Bing would henceforth power Yahoo! Search.[4] I have no idea if this is still the case.

trifecta16 11y ago

You are correct. Formerly, Yahoo used it's own spider that was Slurp!. Currently, Yahoo is using Bing to power is search results. Yahoo has granted that Bing will grant the majority of it's search results. They have just struck a deal with Google, to start including Google search results in it as well. In the future, we should see 51% Bing results and 49% Google results.

rasz_pl 11y ago

Once upon a time in a land long forgotten, before being a holding company for Alibaba investment, Yahoo was actually doing interesting stuff. You could say Yahoo was Google before Google was Google. They did things like Yahoo webpage hyperlink connectivity graph, and tons of other research.