In my case it's coding either some batch jobs in Scala, Spark (on a Hadoop cluster) and Oozie or some real-time pipelines with similar technologies (+Kafka, Spa

In my case it's coding either some batch jobs in Scala, Spark (on a Hadoop cluster) and Oozie or some real-time pipelines with similar technologies (+Kafka, Spark streaming). The job pays well, but the tech is clunky and slow to develop in.