3 ms·
Can confirm on this, storage for a lot of stuff is in S3 and compute is GCP preemtpibles. Works if you have a small dataset which requires a large volume of co
by poooogles 10y ago
Can confirm on this, storage for a lot of stuff is in S3 and compute is GCP preemtpibles. Works if you have a small dataset which requires a large volume of compute.
- dx034 10y agoIs that cheaper than using Google for storage as well? Or are there other reasons for that setup?
- poooogles 10y agoBit of both, no point moving it as the automation/clients that dump data to S3 make it quite hard to change.
- boulos 10y agoGCS supports the S3 API modulo resumable uploads (we do them differently): https://cloud.google.com/storage/docs/migrating https://cloud.google.com/storage/docs/migrating Feel free to send me a note, my contact info is in my profile (I helped build preemptible VMs and I'm sort of fascinated you're doing this).