3 ms·
From a usability standpoint this is really interesting. If I don't have to think about moving to spark but instead just code within the restrictions of the subs
by zitterbewegung 9y ago
From a usability standpoint this is really interesting. If I don't have to think about moving to spark but instead just code within the restrictions of the subset of Python that is really neat.
- tedmiston 9y agoIt's especially interesting because of all of the other implications of moving to Spark — like trying to debug your app code that runs PySpark that runs Scala Spark on the JVM. It's very difficult to trace errors all the way through, no way to use tools like pdb. It takes me so much longer to debug errors in Spark code.