3 ms·

What's used instead? Python? (complete outsider, just curious.)

by flakiness 2y ago

joshlemer 2y ago
Yes. Java, Python.
- flakiness 2y ago
  Ok so boring things won. (Well I'm writing Java and Python every day outside Data context this is not dissing.)
  - markus_zhang 2y ago
    Just curious what do you do? I'm thinking about moving away from data, maybe into something that is a little bit lower-level.
    - flakiness 2y ago
      Java (+Kotlin) for Android, Python for its automation and tooling (and obviously, data.) These aren't very low-level - For Android there is always C++ if you want to go down to metal.
      - markus_zhang 2y ago
        Ah that's interesting. And there is ofc Swift and ObjC for Apple devices. Maybe I should get into app dev. Thanks. Do you think there is a strong market of Android/iOS native app development? As a DE I don't think my previous experience worths much -- maybe a bit more when we move to Flink which uses Java, and the might would rather hire new graduates instead of me.
        flakiness 2y ago
        I don't expect native mobile dev market to grow and was wondering how other disciplines like data is doing ;-)
        markus_zhang 2y ago
        Data is still a big thing, but nowadays vendors successfully removed most of the management because people just want to get things done, so a lot of companies are moving to Snowflake and similar places. You basically do some click ops and hopefully shit sticks on the walls. Interesting if you just like data, but bad if you like the tech beneath. I'd recommend moving away from DWH part of data engineering if you can, and focus on OLTP, streaming which are more technical. The culture is also different.
markus_zhang 2y ago
Python mostly, and Java if you are using Flink. We do both. The thing with Scala is, it's mostly linked to Spark, and then probably a good portion of the gigs out there using Spark are using Databricks, and Databricks is pretty expensive, so people are moving away from it. At least this has been my case for two companies -- one moved to self-host Vertica and the other is about to move to Flink.

What's used instead? Python? (complete outsider, just curious.)

joshlemer 2y ago

Yes. Java, Python.

flakiness 2y ago
Ok so boring things won. (Well I'm writing Java and Python every day outside Data context this is not dissing.)
- markus_zhang 2y ago
  Just curious what do you do? I'm thinking about moving away from data, maybe into something that is a little bit lower-level.
  - flakiness 2y ago
    Java (+Kotlin) for Android, Python for its automation and tooling (and obviously, data.) These aren't very low-level - For Android there is always C++ if you want to go down to metal.
    - markus_zhang 2y ago
      Ah that's interesting. And there is ofc Swift and ObjC for Apple devices. Maybe I should get into app dev. Thanks. Do you think there is a strong market of Android/iOS native app development? As a DE I don't think my previous experience worths much -- maybe a bit more when we move to Flink which uses Java, and the might would rather hire new graduates instead of me.
      - flakiness 2y ago
        I don't expect native mobile dev market to grow and was wondering how other disciplines like data is doing ;-)
        markus_zhang 2y ago
        Data is still a big thing, but nowadays vendors successfully removed most of the management because people just want to get things done, so a lot of companies are moving to Snowflake and similar places. You basically do some click ops and hopefully shit sticks on the walls. Interesting if you just like data, but bad if you like the tech beneath. I'd recommend moving away from DWH part of data engineering if you can, and focus on OLTP, streaming which are more technical. The culture is also different.

markus_zhang 2y ago

Python mostly, and Java if you are using Flink. We do both. The thing with Scala is, it's mostly linked to Spark, and then probably a good portion of the gigs out there using Spark are using Databricks, and Databricks is pretty expensive, so people are moving away from it. At least this has been my case for two companies -- one moved to self-host Vertica and the other is about to move to Flink.