3 ms·

Thanks for the reply! For us, the ability to self-tune is one of Heron's most attractive features. Tuning components/executors in Storm was a big pain point. H

by cozos 9y ago

Thanks for the reply! For us, the ability to self-tune is one of Heron's most attractive features. Tuning components/executors in Storm was a big pain point. Have you guys ever tried using the Dhalion autoscaling combined with hardware autoscaling from a cloud provider (i.e. Azure, AWS EC2)?

avflor 9y ago
No, we have not used auto-scaling with automatic hardware provisioning. We assume that the hardware is there and we just request more containers (e.g, YARN containers). Theoretically, it should be possible to do that if the autoscaling policy is extended to request for additional hardware before changing the parallelism of a stage. But this functionality is not currently there.