3 ms·
I could not tell from the marketing literature - what's the difference between this and EMR?
by shizcakes 10y ago
I could not tell from the marketing literature - what's the difference between this and EMR?
- rad_gruchalski 10y agoI can only assume, this sits higher than EMR. EMR is a managed Hadoop (and likes). This talks about running frameworks like luigi which is a workflow engine for, for example, Hadoop jobs.
- batbomb 10y agoThe jobs management interface. This is more like SLURM, Torque, LSF, etc...
- Pyxl101 10y agoIt looks like you submit jobs to a queue and it spins up capacity to execute them. In that sense it's like EMR. However the jobs are a Docker image or a zip file with shell scripts. In that sense it's not like EMR. I haven't gotten far enough yet to see if it has any distributed compute support, or if each job runs on a single machine. EMR is designed for master/worker architectures with many workers. It looks like AWS Batch might be designed to run each job on a single machine.
- jghn 10y agoIt's more like the container service without setting up your own cluster