13 ms·

Question for those of you who use Spark: Is it possible to use with Go, Rust, Nim or C++? I'm not a fan of those other languages, and I'm also trying to reduce

• perturbation 10y ago
  It would be possible in principle (especially if you can write a Python module bridge that can wrap your C++ / Rust / etc. code), or something that you can load in Java. But, all of the RDD and SparkContext APIs are going to be available only in Java / Scala / Python without a significant amount of work. It's probably not worth it to use another language and wrap it in that way. I would recommend using Scala (for the static typing) or Python (numpy and other libraries are very useful with Spark). They're not hard to pick up, especially when using pyspark + ipython for prototyping locally.