3 ms·
Take any credits you can get from a provider switch and then thoroughly map out your access patterns, ingestion, and egress. Do whatever you can to segment data
by ZeroCool2u 6y ago
Take any credits you can get from a provider switch and then thoroughly map out your access patterns, ingestion, and egress. Do whatever you can to segment data by your needs for availability and modification.
If it's all archival storage then it's pretty straight forward. If you're on GCP you take it all and dump it into archival single region DRA (Durable Reduced Availability) storage for the lowest costs.
Otherwise, identify your segments and figure out a strategy for "load balancing" between standard, nearline, coldline, and archive storage classes. If you can figure out a chronological pattern, you can write a small script that uses the gsutils built-in rsync feature to mirror over data from a higher grade storage class to a lower one at the right time.
The strategy will probably be similar in any of the other big 3 providers as well, but fair warning, some providers archival grade storage does not have immediate availability last I checked.
See:
https://cloud.google.com/storage/docs/storage-classes https://cloud.google.com/storage/docs/storage-classes
https://cloud.google.com/storage/docs/gsutil/commands/rsync https://cloud.google.com/storage/docs/gsutil/commands/rsync
- bushbaba 6y agoFlip side. How much time would that migration take. As a startup focusing that time on product would lead to more VC investment or more sales sooner. With the seed/series funding and sales being many multiples of the cost savings.