>Currently Scala is overwhelmingly used for backend services and/or Spark data pipelines, This is also being taken over by Python. Databricks Koalas is a panda

>Currently Scala is overwhelmingly used for backend services and/or Spark data pipelines, This is also being taken over by Python. Databricks Koalas is a pandas interface on top of Spark - https://koalas.readthedocs.io/en/latest/ https://koalas.readthedocs.io/en/latest/ PySpark was already there (and very much in production). But Koalas (in beta) completely changes the go-to production aspects of spark.