2 ms·
If you don't care to do all the setup yourself, we've recently announced Dataproc as a fully-managed service including support for Preemptible VMs: https://clou
by boulos 11y ago
If you don't care to do all the setup yourself, we've recently announced Dataproc as a fully-managed service including support for Preemptible VMs: https://cloud.google.com/dataproc/ https://cloud.google.com/dataproc/ .
Disclaimer: I work on Compute Engine, specifically Preemptible VMs, but didn't work on Dataproc (though I did add --preemptible to bdutil!)
- stuartaxelowen 11y agoIt only specifies pricing per CPU - how is affected by memory per node? Is that configurable?
- boulos 11y agoI wish they had been more clear, sorry about that (I'll send them the equivalent of a pull request): you pay for Dataproc at a rate of $.01/"core"/hour regardless of which instance shape you use. However, you still pay for the underlying compute and storage; $.01/core/hour is the "service" fee.
- jcrites 11y agoNeat! EMR also added support for Spark this year: https://aws.amazon.com/elasticmapreduce/details/spark/ https://aws.amazon.com/elasticmapreduce/details/spark/