The Julia programming language would help speed up computation. https://julialang.org/benchmarks/ https://julialang.org/benchmarks/ You can use Julia with Apa

The Julia programming language would help speed up computation. https://julialang.org/benchmarks/ https://julialang.org/benchmarks/ You can use Julia with Apache Spark and Julia works with Python via PyCall. If you are working with tabular data the Julia SparkSQL.jl package lets you create Spark apps using just Julia and SQL: https://github.com/propelledanalytics/SparkSQL.jl https://github.com/propelledanalytics/SparkSQL.jl Tutorials: https://propelledanalytics.github.io/Tutorials/ https://propelledanalytics.github.io/Tutorials/