3 ms·
It would be possible in principle (especially if you can write a Python module bridge that can wrap your C++ / Rust / etc. code), or something that you can load
by perturbation 10y ago
It would be possible in principle (especially if you can write a Python module bridge that can wrap your C++ / Rust / etc. code), or something that you can load in Java. But, all of the RDD and SparkContext APIs are going to be available only in Java / Scala / Python without a significant amount of work. It's probably not worth it to use another language and wrap it in that way.
I would recommend using Scala (for the static typing) or Python (numpy and other libraries are very useful with Spark). They're not hard to pick up, especially when using pyspark + ipython for prototyping locally.