Yes, this is very common. But there are also many people who use Common Workflow Language (https://www.commonwl.org/ https://www.commonwl.org/) for this purpos

Yes, this is very common. But there are also many people who use Common Workflow Language (https://www.commonwl.org/ https://www.commonwl.org/) for this purpose. CWL allows for workflow portability between execution engines. The open source engine my team creates (Arvados - https://arvados.org https://arvados.org) is ideal for large-scale processing work. We store, process and manage petabytes of genome data with it, and execute workflows that span hundreds of simultaneous compute nodes.