3 ms·

I still see myself going to spark and Spark SQL for some tasks like stratified sampling which I haven't been able to properly do with pandas. Somehow the spark

I still see myself going to spark and Spark SQL for some tasks like stratified sampling which I haven't been able to properly do with pandas. Somehow the spark DF API feels more intuitive and I was able to figure out a lot by myself.

xiao_haozi 8y ago
Can you use groupby for your stratified sampling work?
mharrison 8y ago
That's interesting as the Spark api was inspired by Pandas