ericxiao251

4 ms·

1. 1.▲
   Show HN: Deep Dive into Spark and Join Optimizations(github.com)

   5 points by ericxiao251 7y ago|0 comments
2. 2.▲
   by ericxiao251 8y ago

   Oh awesome thanks for the resources! I will definitely see how i can incorporate it into my guide :).
3. 3.▲
   by ericxiao251 8y ago

   I haven't looked into/keep up with Arrow much, but if I see fit, I can add more stuff about it :)!
4. 4.▲
   by ericxiao251 8y ago

   Yes I agree, that was the whole premise of the repo 2 years ago! I'm glad you like it :)!
5. 5.▲
   by ericxiao251 8y ago

   Hey quadrature, thanks for the feedback! Would you be able to go into more details about what skew you see :)? In chapter 7 I go into some methods of fixing skewed data when performing joins. This solved a majority of our skew problems, but
6. 6.▲
   Show HN: A Hands-On Guide on PySpark Coding and Best Practices(github.com)

   52 points by ericxiao251 8y ago|8 comments