im actually not sure why everyone is investing in their own scaling frameworks. Would it have been hard to enhance Dask and leverage that ? For example there i

im actually not sure why everyone is investing in their own scaling frameworks. Would it have been hard to enhance Dask and leverage that ? For example there is a huge conversation and lots of work that has happened in Dask to specifically support Pytorch - https://github.com/dask/distributed/issues/2581 https://github.com/dask/distributed/issues/2581 Dask has support for AWS ECS, Kubernetes, GKE, EMR, etc built in - https://docs.dask.org/en/latest/setup/cloud.html https://docs.dask.org/en/latest/setup/cloud.html