3 ms·
I take it you've never actually moved datacenters before? Please don't do this. It may be that their system was simply easier to move. We've moved from DO to a
by icebraining 10y ago
I take it you've never actually moved datacenters before?
Please don't do this. It may be that their system was simply easier to move. We've moved from DO to a local DC earlier this year and it really wasn't a problem, because (1) we didn't have that much data, and (2) we can take a couple of hours of scheduled downtime.
And frankly, I suspect that our situation is closer to the norm than yours. How many companies outside the Fortune 500 really have humongous quantities of data?
- jedberg 10y ago> How many companies outside the Fortune 500 really have humongous quantities of data? Well, just doing the reddit data in 2009 took many days to move, and that was with a planned migration. And that was just text. Nowadays with tons of monitoring and telemetry data and historical data, most companies probably have more than that. Remember, the premise was that bare metal is better than the cloud because it's easier to move, and my counter was that, no, that's not at all true.
- icebraining 10y agoWell, now you've lost me, because according to [1] the data was under 2TB (uncompressed) even as of 2015, so why did it take many days to move? I feel like there's something I'm missing. [1] https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/ https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_eve...
- jedberg 10y agoYou can't just cp live data. You have to migrate it with indexes and rebuild on the fly. If you're willing to take a downtime, sure you can do it in a few days. But you still need servers to move it to. Where do those new servers come from? Are you going to buy a whole new set of servers? How long does that take? My point is that moving one datacenter to another isn't easy and there is a lot of things to think about. My point was that being in the cloud or not is barely relevant. Also that dataset isn't close to complete. It was a lot more data than that.
- mattmanser 10y agoWhy a few days? You keep saying this, why does it take a few days to move terabytes? You're not explaining it at all. Not only that, with reddit most of that data is historic and unchanging so you can pre-move it.