4 ms·
You're right that the data center and the cloud will be very similar, but our assertion at 80legs is that both are very poor choices. I'm not arguing that it's
by jdrock 17y ago
You're right that the data center and the cloud will be very similar, but our assertion at 80legs is that both are very poor choices.
I'm not arguing that it's impossible to do crawling on the cloud. I'm saying it's near-impossible to do it on a large-scale on the cloud. 3500 instances is pretty good, but will still be an order of magnitude slower than what 80legs is capable of.
Now, if you show me someone that has 10,000+ instances on the cloud, I may agree with you!