4 ms·
Does anyone know what kind of GPU support for Spark is mentioned in this announcement? Are they talking about existing XGBoost acceleration, or is it something
by lustigmacher 6y ago
Does anyone know what kind of GPU support for Spark is mentioned in this announcement? Are they talking about existing XGBoost acceleration, or is it something general-purpose?
- T-A 6y agoAt first glance, it seems general purpose: https://www.zdnet.com/article/nvidia-and-databricks-announce-gpu-acceleration-for-spark-3-0/ https://www.zdnet.com/article/nvidia-and-databricks-announce... "based on the open source RAPIDS suite of software libraries" […] "will allow developers to take their Spark code and, without modification, run it on GPUs instead of CPUs" https://rapids.ai/ https://rapids.ai/
- zetazzed 6y agoThis goes beyond the existing Spark+XGBoost GPU acceleration to include ETL, Spark SQL, etc. Coming for Spark 3. Full details here: https://www.nvidia.com/en-us/deep-learning-ai/solutions/data-science/apache-spark-3/ https://www.nvidia.com/en-us/deep-learning-ai/solutions/data...