3 ms·
Why would you pull data from Hive if you are running Spark on HDFS?
by sgt101 9y ago
Why would you pull data from Hive if you are running Spark on HDFS?
- agibsonccc 9y agoLegacy data sources. People tend to have a mix of technologies. You can use spark sql to do this: https://spark.apache.org/docs/latest/sql-programming-guide.html https://spark.apache.org/docs/latest/sql-programming-guide.h... Spark can also access hdfs. You are typically mixing data sources as well.