3 ms·
>Would have loved to have read some technical details on how 40 Tbyte was transferred in an hour, even migrated. Perhaps I'm missing something but that doesn't
by Havoc 7y ago
>Would have loved to have read some technical details on how 40 Tbyte was transferred in an hour, even migrated.
Perhaps I'm missing something but that doesn't seem hard considering:
1) It's only like 3x high end consumer level 16TB HDDs
2) This is Amazon...they have AWS - really fat pipes and endless horsepower on demand
- kondro 7y agoHave you tried transferring 40TB from 3x spinning disk HDD… let alone an actively running DB infrastructure? The maximum sustained transfer rate of a 16TB Seagate Exos X16 is 261MB/s. That would take 17 hours to transfer at full speed. Not that the data storage would look like that, but even at 100Gbps networking operating at 80% (about what you'd achieve realistically) it would take 70 minutes to transfer 40TB at full wire speeds. But we're not talking about full-wire speeds. We're talking about exporting from an Oracle DB and importing to an entirely different DB. The file transfer task isn't the hard bit, it's the actual data migration along the way. That's a massive undertaking and I'm surprised any of the migration tasks were able to complete with such a small amount of downtime.