3 ms·
Many of us have been using GPU accelerated Spark for years: https://developer.nvidia.com/rapids/ https://developer.nvidia.com/rapids/ https://github.com/NVIDI
by threeseed 1y ago
Many of us have been using GPU accelerated Spark for years:
https://developer.nvidia.com/rapids/ https://developer.nvidia.com/rapids/
https://github.com/NVIDIA/spark-rapids https://github.com/NVIDIA/spark-rapids
And it's supported on AWS:
https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-rapids.html https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spar...
- winwang 1y agoIndeed, Spark-RAPIDS has been around for a while! And it's quite simple to have a setup that works. Most of the issues come after the initial PoC, especially for teams not wanting to manage infra, not to mention GPU infra.