2 ms·
"Oh, no, I didn't think about sending my updates to Cliqz because Google is the dominant player anyway"
by darkwater 7y ago
"Oh, no, I didn't think about sending my updates to Cliqz because Google is the dominant player anyway"
- hinkley 7y agoYeah I don't think a straight hub and spoke structured pub-sub approach is the right answer, either. The thing is, though, if you don't send the data out, you're going to get crawled. So sending identical data to 5 crawlers instead of 3 is probably still cheaper. Only of course the incumbents will add extra features on that don't work for everyone else...