4 ms·
Just to say it upfront, I'm nothing like big enough for a lot of the options you have available. > Can you describe more about the "data hosted at another prov
by Veratyr 11y ago
Just to say it upfront, I'm nothing like big enough for a lot of the options you have available.
> Can you describe more about the "data hosted at another provider"?
It's all at OVH and Hetzner. They offer very cheap storage and bandwidth.
> interconnect
I'm not big enough for those options and regardless, all of your peering/interconnect options are CDN priced for inter-region and only slightly better for intra-region. They just don't make sense.
Say I want to store 100TB of data and pump it through some kind of processing pipeline, outputting the same amount of data. At OVH I pay ~$0.0075/GB on storage coming to ~$1.5k/month (since the processing results in double storage). Say my processing is light on memory and can run at 1MB/s/CPU and I want to be finished in a day. I need 1150 CPU cores for 24h and at OVH that would cost me ~$1300 and bandwidth is free and unlimited. At GCE I can run on pre-emptible instances and pay ~$284 for the compute but I have to pay for 100TB of premium egress bandwidth I don't need, which adds 100 * 1000 * 0.04 (generously assuming I can get peering/interconnect) which is $4000. GCE is absolutely unusable for jobs like this in its current state.
Sure I could move data to GCS but in that case my $1.5k bill for storage turns into a $5.2k bill per month.