2 ms·
> It turns out that a huge fraction of Spark workloads fall into this model, especially since we support complex types and nested structures. The first step of
by EdwardDiego 12y ago
> It turns out that a huge fraction of Spark workloads fall into this model, especially since we support complex types and nested structures.
The first step of all my Spark tasks is "turn this RDD[String] into an RDD of parsed JSON", or turning CSV into case classes.
What JSON parser will dataframes be using? I presume Jackson?