3 ms·
Will the DataFrame API work with Spark Streaming?
by zodvik 12y ago
Will the DataFrame API work with Spark Streaming?
- rxin 12y agoThere are some ways you can integrate the two. E.g. Streaming allows you to apply arbitrary RDD transformations, and thus you can pass a physical plan generated by DataFrame into streaming. We will work on better integration in the future too.